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Abstract 



This article belongs to a series on geometric complexity theory (GCT), an 
approach to the P vs. NP and related problems through algebraic geometry 
and representation theory. The basic principle behind this approach is called 
the flip. In essence, it reduces the negative hypothesis in complexity theory 
(the lower bound problems), such as the P vs. NP problem in characteristic 
zero, to the positive hypothesis in complexity theory (the upper bound prob- 
lems): specifically, to showing that the problems of deciding nonvanishing of 
the fundamental structural constants in representation theory and algebraic 
geometry, such as the well known plethysm constants [McllFHj . belong to the 
complexity class P. In this article, we suggest a plan for implementing the 
flip, i.e., for showing that these decision problems belong to P. This is based 
on the reduction of the preceding complexity-theoretic positive hypotheses to 
mathematical positivity hypotheses: specifically, to showing that there exist 
positive formulae-i.e. formulae with nonnegative coefficients-for the struc- 
tural constants under consideration and certain functions associated with 
them. These turn out be intimately related to the similar positivity proper- 
ties of the Kazhdan-Lusztig polynomials |KLH IKL2] and the multiplicative 
structural constants of the canonical (global crystal) bases |Kas2t ILu2] in 
the theory of Drinfeld-Jimbo quantum groups. The known proofs of these 
positivity properties depend on the Riemann hypothesis over finite fields 
(Weil conjectures proved in |D1] ) and the related results |BBD| . Thus the 
reduction here, in conjunction with the flip, in essence, says that the validity 
of the P 7^ NP conjecture in characteristic zero is intimately linked to the 
Riemann hypothesis over flnite flelds and related problems. 

The main ingradients of this reduction are as follows. 

First, we formulate a general paradigm of saturated, and more strongly, 
positive integer programming, and show that it has a polynomial time al- 
gorithm, extending and building on the techniques in |DM2l IGCT31 IGCT51 

icmiimiicm iKii iKTT] . 

Second, building on the work of Boutot |Bouj and Brion (cf. |Dh| ). we 
show that the stretching functions associated with the structural constants 
under consideration are quasipolynomials, generalizing the known result that 
the stretching function associated with the Littlewood- Richardson coefficient 
is a polynomial for type A [Pert IKij and a quasi-polynomial for general types 



[BZllDhj . In particular, this proves Kirillov's conjecture |Ki| for the plethysm 
constants. 

Third, using these stretching quasi-polynomials, we formulate the math- 
ematical saturation and positivity hypotheses for the plethysm and other 
structural constants under consideration, which generalize the known sat- 
uration and conjectural positivity properties of the Littlewood-Richardson 
coefficients |KTH IDM21 IKTTj . Assuming these hypotheses, it follows that 
the problem of deciding nonvanishing of any of these structural constants, 
modulo a small relaxation, can be transformed in polynomial time into a 
saturated, and more strongly, positive integer programming problem, and 
hence, can be solved in polynomial time. 

Fourth, we give theoretical and experimental results in support of these 
hypotheses. 

Finally, we suggest an approach to prove these positivity hypotheses 
motivated by the works on Kazhdan-Lusztig bases for Hecke algebras |KLH 
IKL2j and the canonical (global crystal) bases of Kashiwara and Lusztig \Lu2\ 
ILu4[ lKas2] for representations of Drinfeld-Jimbo quantum groups |Dri[ [Ji] . 
Steps in this direction are taken |(;(]T4[ KK^TTl [CTTTS] . 

Specifically, in |GCT41 IGCTTj are constructed nonstandard quantum 
groups, with compact real forms, which are generalizations of the Drinfeld- 
Jimbo quantum group, and also associated nonstandard algebras, whose re- 
lationship with the nonstandard quantum groups is conjecturally similar 
to the relationship of the Hecke algebra with the Drinfeld-Jimbo quantum 
group. The article |GCT8j gives conjecturally correct algorithms to con- 
struct canonical bases of the matrix coordinate rings of the nonstandard 
quantum groups and of nonstandard algebras that have conjectural posi- 
tivity properties analogous to those of the canonical (global crystal) bases, 
as per Kashiwara and Lusztig, of the coordinate ring of the Drinfeld-Jimbo 
quantum group, and the Kazhdan-Lusztig basis of the Hecke algebra. These 
positivity conjectures (hypotheses) lie at the heart of this approach. In view 
of |KL2l lLii2] . their validity is intimately linked to the Riemann hypothesis 
over finite fields and the related works mentioned above. 
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Chapter 1 

Introduction 



This article belongs to a series of papers, [GCTlj to [GCTllj . on geomet- 
ric complexity theory (GCT), which is an approach to the P vs. NP and 
related problems in complexity theory through algebraic geometry and rep- 
resentation theory. We assume here that the underlying field of computation 
is of characteristic zero. The usual P vs. NP problem is over a finite field. 
The characteristic zero version is its weaker, formal implication, and philo- 
sophically, the crux. 

The basic principle underlying GCT is called the flip [GCTfiip] . The 
flip, in essence, reduces the negative hypotheses (lower bound problems) in 
complexity theory, such as the P ^INP problem in characteristic zero, to 
positive hypotheses in complexity theory (upper bound problems): specifi- 
cally, to the problem of showing that a series of decision problems in rep- 
resentation theory and algebraic geometry belong to the complexity class 
P. Each of these decision problem is of the form: Given a nonnegative 
structural constant in representation theory or geometric invariant theory, 
such as the well known plethysm constant, decide if it is nonzero (nonvan- 
ishing), or rather, if is nonzero after a small relaxation. This flip from the 
negative to the positive may be considered to be a nonrelativizable form of 
the flip-from the undecidable to the decidable-that underlies the proof of 
Godel's incompleteness theorem. But the classical diagonalization technique 
in Godel's result is relativizable [BGSj . and hence, not applicable to the P 
vs. NP problem. The flip, in contrast, is nonrelativizable. It is furthermore 
nonnaturalizable [GCTlOj ): i.e., it crosses the natural proof barrier |RRj 
that any approach to the P vs. NP problem must cross. 

We suggest here a plan for implementating the flip; i.e., for showing that 
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the decision problems above belong to P. This is based on the reduction 
in this paper of the complexity-theoretic positivity hypotheses mentioned 
above to mathematical positivity hypotheses: specifically, to showing that 
there exist positive formulae for the structural constants under consideration 
and certain functions associated with them. We also give theoretical and 
experimental evidence in support of the latter hypotheses. 

Here we say that a formula is positive if its coefficients are nonegative. 
The problem finding the positive formulae as above turns out be intimately 
related to the analogous problem for the Kazhdan-Lusztig polynomials [KLlj 
and the multiplicative structural constants of the canonical (global crystal) 
bases |Kas21 ILu2j in the theory of Drinfeld-Jimbo quantum groups. The 
known solution to the latter problem |KL2l ILu2j depends on the Riemann 
hypothesis over finite fields, proved in jPlj . and the related results in |BBD] . 
Thus the flip and the reduction here together roughly say that the valid- 
ity of the P ^ NP conjecture in characteristic zero is intimately linked 
to the Riemann hypothesis over finite fields and related problems. This is 
illustrated in Figure II. 1| the question marks there indicate unsolved prob- 
lems. It seems that substantial extension of the techniques related to the 
Riemann hypothesis over finite fields may be needed to prove the required 
mathematical positivity hypotheses here. We do not have the necessary 
mathematical expertize for this task. But it is our hope that the experts in 
algebraic geometry and representation theory will have something to say on 
this matter. 

It may be conjectured that the flip paradigm would also work in the 
context of the usual P vs. NP problem over F2 (the boolean field) or the 
finite field Fp. But implementation of the fiip over a finite field is expected 
to be much harder than in characteristic zero. That is why we focus on 
characteristic zero here, deferring discussion of the problems that arise over 
finite field to [(K^Tllj . 

Now we turn to a more detailed exposition of the main results in this 
paper and of Figure 11.11 

Acknoledgements 

We are grateful to the authors of |BORj for pointing out an error in the 
saturation hypothesis (SH) in the earlier version of this paper. It has been 
corrected in this version with appropriate relaxation without affecting the 
overall approach of GCT (cf. Section [L6l and also |GCT6erratumj ) . We 
are also grateful to Peter Littelmann for bringing the reference |Dh| to our 
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Figure 1.1: Pictorial depiction of the basic plan for implementing the fiip 
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attention, to H. Narayanan for suggesting the use of [KBj in the proof of 
Theorem 13.1.11 and bringing the positivity conjecture in |DM2j to our atten- 
tion, and to Madhav Nori for a helpful discussion. The experimental results 
in Chapter [6] were obtained using Latte |DHHH| . 

1.1 The decision problems 

We now describe the relevant decision problems in representation theory 
and algebraic geometry. The actual decision problems that arise in the flip 
(cf. the second box in Figure II. ip are relaxed versions of these problems 
described later (cf. Hypothesis ll.l.6p . 

Problem 1.1.1 (Decision version of the Kronecker problem) 

Given partitions A, fi, vr, decide nonvanishing of the Kronecker coefficient 
kj ^. This is the multiplicity of the irreducible representation (Specht mod- 
ule ) Sn of the symmetric group Sn in the tensor product 5a 5"^ • 

Equivalently f7^ . let H = GL„(C) x GL„(C) and p : H ^ G = 
GL(C" (8) C") = GL„2(C) the natural embedding. Then k'^ ^ is the multi- 
plicity of the H -module Va(G'L„(C)) (8) Vfj,{GLn{C)) in the G -module Vn{G), 
considered as an H-module via the embedding p. 

Here Vx{GLn{C)) denotes the irreducible representation (Weyl module) 
of GLn{C) corresponding to the partition A; K-(G) is the Weyl module of 
G = GL„2(C). 

Problem 11. 1.11 is a special case of the following generalized plethysm 
problem. 

Problem 1.1.2 (Decision version of the plethysm problem) 

Given partitions A, p, vr, decide nonvanishing of the plethysm constant 
a\ ^. This is the multiplicity of the irreducible representation V^(i7) of H = 
GLn{C) in the irreducible representation Vx{G) of G = GL{V^), where = 
Vf^{H) is an irreducible representation H . Here Vx{G) is considered an H- 
module via the representation map p : H ^ G = GL(V^). 

(Decision version of the generalized plethysm problem) 

The same as above, allowing H to be any connected reductive group. 

This is a special case of the following fundamental problem of represen- 
tation theory (characteristic zero): 
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Problem 1.1.3 (Decision version of the subgroup restriction problem) 

Let G be connected reductive group, H a reductive group, possibly discon- 
nected, and p : H ^ G an explicit, polynomial homomorphism (as defined 
in Section Here H will generally be a subgroup of G, and p its em- 

bedding. Let Vt^{H) be an irreducible representation of H , and Vx{G) an 
irreducible representation of G. Here vr and A denote the classifying labels 
of the irreducible representations V^(-ff) and V\{G), respectively. Let m'^ be 
the multiplicity o/V^(-f/) in Vx{G), considered as an H-module via p. 

Given specifications of the embedding p and the labels A, vr, as described 
in Section \3^\ decide nonvanishing of the multiplicity m\. 

All reductive groups in this paper are over C. The reductive groups 
that arise in GCT in characteristic zero are: the general and special linear 
groups GLn{C) and 5L„(C), algebraic tori, the symmetric group 5„, and 
the groups formed from these by (semidirect) products. The reader may 
wish to focus on just these concrete cases, since all main ideas in this paper 
are illustrated therein. 

Problem 11.1.31 is, in turn, a special case of the following most general 
problem. 

Problem 1.1.4 (Decision problem in geometric invariant theory) 

Let H be a reductive group, possibly disconnected, X a projective H- 
variety (H -scheme), i.e., a variety with H -action. Let p denote this H- 
action. Let R = (BdRd be the homogeneous coordinate ring of X. Assume 
that the singularities of spec{R) are rational. 

We assume that X and p have special properties (as described in Sec- 
tion \3. 5|) . so that, in particular, they have short specifications. Let V.j^{H) 
be an irreducible representation of H . Let be the multiplicity o/ in 
Rd, considered as an H-module via the action p. 

Given d, ir, the specifications of X and p, decide nonvanishing of the 
multiplicity sj. 

This last problem is hopeless for general X. Indeed the usual specifi- 
cation of X, say in terms of the generators of the ideal of its appropriate 
embedding, is so large as to make this problem meaningless for a general 
X. But the instances of this decision problem that arise in GCT are for the 
following very special kinds of projective //-varieties X, which, in particular, 
have small specifications (Section 13.50 : 
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1. G/P, where G is a connected, reductive group, P C G its parabolic 
subgroup, and if C G a reductive subgroup with an exphcit polyno- 
mial embedding. Problem 11.1.31 reduces to this special case of Prob- 
lem [LLl cf. Section [331 

2. Class varieties [GCTH lGCT2j . which are associated with the funda- 
mental complexity classes such as P and NP. They are very special 
like G/P, with conjecturally rational singularities [GCTlOj . Each class 
variety is specified by the complexity class and the parameters of the 
lower bound problem under consideration. Briefly, the P vs. NP prob- 
lem in characteristic zero is reduced in [GCTll IGCT2j to showing that 
the class variety corresponding to the complexity class NP and the pa- 
rameters of the lower bound problem (such as the input size) cannot 
be embedded in the class variety corresponding to the complexity class 
P and the same parameters. Efficient criteria for the decision prob- 
lems stated above are needed to construct explicit obstructions |GCT2j 
to such embeddings, thereby proving their nonexistence. Specifically, 
Problems 11.1.31 and 11.1.41 are the decision problems associated with 
Problems 2.5 and 2.6 in |GCT2j . respectively. See Sections 17.6117.71 for 
a brief review of this story. 

For these varieties Problem 11.1.41 turns out to be qualitatively similar to 
Problem [TO] (cf. Section [33] and [GCT2l [GGTIO] ) . For this reason, the 
Kronecker and the plethysm problems, which lie at the heart of the subgroup 
restriction problem, can be taken as the main prototypes of the decision 
problems that arise here. 

One can now ask: 

Question 1.1.5 Do the decision problems above (Problems \1.1.1\\1.1.3\ and 
Problen \1.1.4\ when X therein is G/P or a class variety) belong to P? That 
is, can the nonvanishing of any of structural constants in these problems 
be decided in poly{{x)) time, where x denotes the input- specification of the 
structural constant and (x) its bitlength? 

For Problem 11.1.21 the input specification for the plethysm constant ^ 
is given in the form of a triple x = (A, /i, vr). Here the partition A is specified 
as a sequence of positive integers Ai > A2 > • • • Afc > (the zero parts of 
the partition are suppressed); k is called the height or length of A, and is 
denoted by ht(A). The bitlength (A) is defined to be the total bitlength of 
the integers A^'s. The bitlength (x) is defined to be (A) -|- (/i) -|- (vr). A 
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detailed specification of tlie input specification x and its bitlength (x) for 
the other problems is given in Section 13.31 

For the reasons described in Section 11.61 Question 11.1.51 may not have 
an affirmative answer in general; i.e., these problems may not be in P in 
their strict form stated above. The following main conjectural complexity- 
theoretic positivity hypothesis governing the flip says that the relaxed forms 
of these decision problems described in Section [3.31 belong to P. As we shall 
see in Chapter [71 these relaxed forms suffice for the purposes of the flip. 

Hypothesis 1.1.6 (PHflip) The relaxed forms (cf. Section \373\) of Prob- 
lems M.l.SX M.l.SX and the special cases of Problem 1.1.4\ when X 



therein is G/P or a class variety-which together include all decision prob- 
lems that arise in the flip-belong to the complexity class P. 

This means nonvanishing of any of these structural constants, modulo a 
small relaxation (as described in Section [Qj] . can be decided in poly{{x)) 
time, where x denotes the input- specification of the structural constant and 
(x) its bitlength. 



The phrase "modulo a small relaxation" in the relaxed form of the 
plethysm problem means the following: 

(a) Let h = dimG + htA + htvr, where dim(G) is the dimension of the 
group G in Problem ll.1.21 Then there exist absolute nonnegative constants 
c and c', independent of A, /x and tt, such that nonvanishing of the relaxed 
(stretched) plethysm constant o^J^^, for any positive integral relaxation 

parameter b > ch^' , can be decided in 0(poly((A), (//), (vr), (6))) time, where 
{b) denotes the bitlength b. The notation poly ((A), (^u), (vr), (6)) here means 
bounded by a polynomial of constant degree in (A), (/i), (vr) and {b). In 
particular, the time is 0(poly((A), (/.i), (vr)) if the relaxation parameter b is 
small; i.e. if its bitlength (6) is 0(poly((A), (/x), (vr))). (Observe that the bit 
length of/iisO(poly((A),(^),(^))).) 

(b) There exists a polynomial time algorithm for deciding nonvanishing of 
a\ which works correctly on almost all A, /i and vr. Here polynomial time 
means 0(poly((A), (//), (vr)) time. The meaning of "correctly on almost all" 
is specified in Hypothesis 11.6.51 below. 

A detailed specification of the relaxation, i.e., the meaning of the phrase 
"modulo a small relaxation" for the other problems is given in Section 13. 31 

The structural constants in Problems ll.l.HfTTL3] are of fundamental im- 
portance in representation theory. The kronecker and the plethysm con- 
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stants in Problems II. 1.11 and 11.1.21 i^i particular, have been studied inten- 
sively; see [FHl IMcl ISt4j for their significance. There are many known 
formulae for these structural constants based on on the character formulae 
in representation theory. Several formulae for the characters of connected, 
reductive groups are known by now |FHj . starting with the Weyl character 
formula. For the symmetric group, there is the Frobenius character formula 
[FHj . for the general linear group over a finite field, Green's formula |Mcj . 
and for finite simple groups of Lie type, the character formula of Deligne- 
Lusztig |DLj . and Lusztig |Lulj . (Finite simple groups of Lie type, other 
than GLn{Fq), are not needed in GOT.) 

One obvious method for deciding nonvanishing of the structural con- 
stants in Problems ll.l.HfTTL4l is to compute them exactly. But all known al- 
gorithms for exact computation of the structural constants in Problems 1 1.1. 11 
11.1.31 take exponential time. This is expected, since this problem is 
complete. In fact, even the problem of exact computation of a Kostka 
number, which is a very special case of these structural constants, is #P- 
complete [N]. This means there is no polynomial time algorithm for com- 
puting any of them, assuming P ^ NP. 

Of course, there are ^P-complete quantities-e.g. the permanent of a 
nonnegative matrix [Vj-whose nonvanishing can still be decided in polyno- 
mial time |Sc] . But the decision problems above are of a totally different 
kind and, at the surface, appear to have inherently exponential complexity. 
This is because the dimensions of the irreducible representations that occur 
in their statements can be exponential in the ranks of the groups involved 
and the bit lengths of the classifying labels of these representations. For 
example, the dimension of the Weyl module Vx{GLn{C)) can be exponen- 
tial in n and the bit length of the partition A. Furthermore, the number 
of terms in any of the preceding character formulae is also exponential. All 
these decisions problems ask if one exponential dimensional representation 
can occur within another exponential dimensional representation. To solve 
them, it may seem necessary to take a detailed look into these representa- 
tions and/or the character formulae of exponential complexity. Hence, it 
seemed hard to believe that nonvanishing of these structural constants can, 
nevertheless, be decided in polynomial time (modulo a small relaxation). 
This constituted the main philosophical obstacle in the course of GCT. 
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1.2 Deciding nonvanishing of Littlewood-Richardson 
coefficients 



The first result, which indicated that this obstacle may be removable, came 
in the wake of the saturation theorem of Knutson and Tao |KTlj . This 
concerns the following special case of Problem 11.1.31 with G = H x H, the 
embedding p : H G being diagonal. 

Problem 1.2.1 (Littlewood-Richardson problem) 

Given a complex semisimple, simply connected Lie group H, and its 
dominant weights a, /3, A, decide nonvanishing of a generalized Littelwood- 
Richardson coefficient c^^. This is the multiplicity of the irreducible repre- 
sentation Vx{H) of H in the tensor product Va{H) (g) Vp^H). 

It was shown in |GCT3l IKT21 IDM2| independently that nonvanishing of 
the Littlewood-Richardson coefficient of type A can be decided in polyno- 
mial time; i.e., polynomial in the bit lengths of a,/3, A. Furthermore, the 
algorithm in |GCT3j works in strongly polynomial time in the terminology 
of [GLSj : cf. Section [2.11 The three main ingradients in this result are: 

1. PHI: The Littlewood-Richarson rule, which goes back to 1940's, and 
whose most important feature is that it is positive-i.e., it involves no 
alternating signs as in character-based formulae-and its strengthening 
in |BZj . which gives a positive, polyhedral formula for the Littlewood- 
Richardson coefficient as the number of integer points in a polytope; 
this can be the BZ-polytope |BZj or the hive polytope |KTlj . We 
shall refer to this positivity property as the first positivity hypothesis 
(PHI). 

2. The polynomial and strongly polynomial time algorithms for linear 
programming \Kh.\ I Taj , and 

3. SH: The saturation theorem of Knutson and Tao |KT1| . This says 
that p is nonzero if cj^^ is nonzero for any n > 1. We shall refer 
to this saturation property as the saturation hypothesis (SH). 

Brion [Z] observed that the verbatim translation of the saturation prop- 
erty in [KTlj fails to hold for the the generalized Littlewood-Richardson 
coefficients of types B, C, D (it also fails for the Kronecker coefficients, as 
well as the plethysm constants jKij ) . Hence, the algorithms in |GCT3t[KT2l 
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IDM2j do not work in types B, C and D. Fortunately, this situation can 
be remedied. It is shown in |GCT5j that nonvanishing of the generahzed 
Littewood-Richardson coefficient ^ of arbitrary type can be decided in 
(strongly) polynomial time, assuming the positivity conjecture of De Loera 
and McAllister |DM2j . This conjectural hypothesis, based on considerable 
experimental evidence, is as follows. Let 

be the stretching function associated with the Littlewood-Richardson co- 
efficient c^p. It is known to be a polynomial in type A jPerl IKij . and a 
quasi-polynomial, in general \BZ\ IDh[ IDM2j . Recall that a fuction f{n) is 
called a quasi-polynomial if there exist I polynomials fj{n), 1 < j < /, such 
that /(n) = fj{n) if n = j mod I. Here / is supposed to be the smallest such 
integer, and is called the period of f(n). The period of c^^(n) for types 
B,C,D is either 1 or 2 |DM2j . In general, it is bounded by a fixed constant 
depending on the types of the simple factors the Lie algebra. 



Definition 1.2.2 We say that the quasi-polynomial f{n) is strictly posi- 
tive, if all coefficients of fj{n), for all j, are nonnegative; i.e., the nonzero 
coefficients are positive. In general, we define the positivity index p{f) of 
f to be the smallest nonnegative integer such that fin + p{f)) is strictly 
positive. We also say that f{n) is positive with index p{f). 

Thus f{n) is strictly positive, iff its positivity index is zero. 

With this terminology, the hypothesis mentioned above is the following. 
We say a connected reductive group H is classical, if each simple factor of 
its Lie algebra TC is of type A, B, C or D. We also say that the type of H 
or TC is classical. 



Hypothesis 1.2.3 (PH2).- JKTI\ \DM^ Assume that H in Problem[r2J\ 
is classical. Then the Littlewood-Richardson stretching quasi-polynomial 
c'^ p{n) is strictly positive. 

We shall refer to this as the second positivity hypothesis (PH2). This 
was conjectured by King, Tollu and Toumazet [KTTj for type A, and De 
Loera and McAllister for types B, C, D. Since the stretching function above 
is a polynomial in type A, the positivity conjecture of King et al clearly 
implies the saturation theorem of Knutson and Tao. That is, PH2 implies 
SH for type A. 
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We can formulate an analogue of SH for a Lie algerbra of arbitrary clas- 
sical type so that PH2 implies SH for an arbitrary type. For this, we need 
to formulate the notion of a saturated quasi-polynomial, which is not con- 
tradicted by the counterexamples, mentioned above, to verbatim translation 
of the saturation property in |KTll iKi] to the setting of quasi-polynomials. 
Specifically, the notion of saturation in [KTHlKi] works well if the stretching 
function is a polynomial, but not so if it is a quasipolynomial. Let /(n) be 
a quasi-polynomial with period I. Let fj{n), 1 < j < /, be the polynomials 
such that /(n) = fj{n) if n = j mod /. The index of /, index(/), is defined 
to be the smallest j such that the polynomial fj{n) is not identically zero. 
If /(n) is identically zero, we let index(/) = 0. If /(I) 7^ 0, then clearly 
index(/) = 1. 

Definition 1.2.4 We say that f{n) is strictly saturated i/ /or any i : fi{n) > 
for every n > 1 whenever fi{n) is not identically zero. The saturation in- 
dex s{f) of f is defined to he the smallest nonnegative integer such that 
f{n + s{f)) is strictly saturated. We also say that f{n) is saturated with 
index s{f). 

Thus f{n) is strictly saturated iff its saturation index is zero. Clearly 
the saturation idex is bounded above by the positivity index. Thus if f{n) 
is strictly positive, it is strictly saturated. Hence, PH2 (Hypothesis 11.2.30 
implies: 

Hypothesis 1.2.5 (SH).- The Littlewood-Richardson stretching quasi-polynomial 
c^^(n) of arbitary classical type is strictly saturated. 

The polynomial time algorithm in |GCT5j works assuming SH as well. 
For the Littlewood-Richardson coefficient of type A, the notion of strict 
saturation here coincides with the notion of saturation in [KTlj since ^(n) 
is a polynomial in that case. Knutson and Tao |KT1| also conjectured 
a generalized saturation property for arbitrary types. But that property, 
unlike the one defined above, is only conjectured to be sufficient, but not 
claimed to be, or expected to be necessary. For this reason, it cannot be 
used in the complexity-theoretic applications in this paper. 

There is another positivity conjecture for Littlewood-Richardson coeffi- 
cients that also implies the saturation theorem of Knutson and Tao. For 
this consider the generating function 




(1.2) 



n>0 
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It is a rational function since c^^(n) is a quasi-polynomial |Stlj . For type 
A, if c^^(n) is not identically zero, then ^{t) is a rational function of 
form 

hdf^ H h /in , , 

(1 • <i-3) 

since p{n) is a polynomial |Stlj . It is conjectured in [KTTj that: 

Hypothesis 1.2.6 (^'HS/J The coefficients hi 's in eq Al.S\) are nonneaative 
(and ho = I). 

We shall call this the third positivity hypothesis (PII3). It clearly implies SH 
for Littlewood-Richardson coefficients of type A. To describe its analogue 
for arbitrary classical type we need a definition. 

Let F{t) = fi''^)^^ generating function associated with the 

quasi-polynomial /(n). It is a rational function |Stl| . 

Definition 1.2.7 We say that F{t) has a positive form, if, when f{n) is 
not identically zero, it can he expressed in the form 

Fit) = + + (1.4) 

where (1) ho = 1, and hi's are nonnegative integers, (2) ai's and di's are 
positive integers, (3) di = d + 1, where d = max deg(/j(n)) is the degree 
of fin). 

We define the modular index of this positive form to be max{aj}. 

If Fit) has a positive form with oq = 1, then fin) is strictly saturated 
(Definition I1.2.4P ; this easily follows from the power series expansion of the 
right hand side of eq. (|1.4p . 

The analogue of Hypothesis 11.2.61 for arbitrary classical type is: 

Hypothesis 1.2.8 (PJ13:) The rational function C^^(t) has a positive 
form, with = 1, of modular index bounded by a constant depending only 
on the types of the simple factors of the Lie algebra of H . 

This too implies SH for arbitrary classical type. For types B, C, D, the 
constant above is 2. Experimental evidence for this hypothesis is given in 
Section 16.11 
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The analogue of the PH3, even in the more general ^-setting, is known to 
hold for the generating function of the Kostant partition function of type A, 
and more generally, for a parabolic Kostant partition function; cf. Kirillov 
[Kij . This also gives a support for the PH3 above, given a close relationship 
between Littlewood-Richardson coefficients and Kostant partition functions 

m- 

1.3 Back to the general decision problems 

It may be remarked that the Littlewood-Richardson problem actually never 
arises in the flip. It is only used as a simplest proptotype of the actual (much 
harder) problems that arise-namely relaxed forms of Problems ll.l.HfTTTTil 

Now we turn to these problems. The goal is to generalize the preced- 
ing results and hypotheses for the Littlewood-Richardson coefficients to the 
structural constants that arise in these problems. The problem of finding a 
positive, combinatorial formula for the plethysm constant (Problem ll.l.2p . 
akin to the positive Littlewood-Richardson rule, has already been recog- 
nized as an outstanding, classical problem in representation theory [St4| - 
the known formulae based on character theory mentioned in Section 11.11 
are not positive, because they involve alternating signs. Indeed, existence 
of such a formula is a part of the first positivity hypothesis (PHI) below 
for the plethysm constant, and this problem is the main focus of the work 
in |GCT4l IGCT71 IGCT81 IGCT9| . In view of the intensive work on the 
plethym constant in the literature, it has now become clear that the com- 
plexity of the plethysm problem (Problem ll.l.2p is far higher than that of 
the Littlewood-Richardson problem (Problem ll.2.ip . This gap in the com- 
plexity is the main source of difficulties that has to be addressed. We now 
state the main ingradients in the plan in this paper to show that the relaxed 
forms of Problems fTXTl fTX2l fTOl and fTXil with X = G/P ov a class 
variety, belong to P. 

1.4 Saturated and positive integer programming 

First, we formulate a general algorithmic paradigm of saturated and positive 
integer programming that can be applied in the context of these problems. 

Let A be an m X n integer matrix, and b an integral m-vector. An integer 
programming problem asks if the polytope P : Ax < b contains an integer 
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point. In general, it is NP-complete. We want to define its relaxed version, 
which will turn out to have a polynomial time algorithm. 

We allow m, the number of constraints, to be exponential in n. Hence, 
we cannot assume that A and b are explicitly specified. Rather, it is assumed 
that the polytope P is specified in the form of a (polynomial-time) separation 
oracle in the spirit of Grotschel, Lovasz and Schrijver |GLSj : cf. Section [231 
Given a point x S M", the separation oracle tells if x S P, and if not, gives 
a hyperplane that separates x from P. 

Let fp{n) be the Ehrhart quasi-polynomial of P \Stl\ . By definition, 
fp{n) is the number of integer points in the dilated polytope nP. 

An integer programming problem is called saturated, if 

1. The specification of P also contains a number sie(P), called the sat- 
uration index estimate, with the guarantee that the saturation in- 
dex s{fp) < sie(P); cf. Definition 11.2.41 In particular, this means 
fp{n + sie(P)) is strictly saturated. 

2. the goal of the problem is to give an efficient algorithm to decide if, 
given an integral relaxation parameter c > sie{P), if cP contains an 
integer point. 

The algorithm has to work only for relaxation parameters c > sie(P). In 
particular, if sie(P) > 1, the algorithm problem does not have to determine 
if P contains an integer point. 

An integer programming problem is called positive, if 

1. the specification of P also contains a number pie(P), called the pos- 
itivity index estimate, with the guarantee that the positivity index 
pifp) ^ pie(-P); cf. Definition 11.2.21 In particular, this means fp{n-\- 
pie(P)) is strictly positive. 

2. the goal of the problem is to give an efficient algorithm to decide if, 
given an integral relaxation parameter c > pie(P), if cP contains an 
integer point. 

Again, the algorithm has to work only for relaxation parameters c > pie(P). 
Since s(/p) < pifp), a positive integer programming problem is also satu- 
rated. 

The following is the main complexity-theoretic result in this paper. 
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Theorem 1.4.1 (cf. Section\3^ 



1. Index of the Ehrhart quasi-polynomial fp{n) of a polytope P presented 
by a separation oracle can be computed in oracle-polynomial time, and 
hence, in polynomial time, assuming that the oracle works in polyno- 
mial time. 

2. A saturated, and hence positive, integer programming problem has a 
polynomial time algorithm. 

3. Suppose the polytopes P 's that arise in a specific decision problem have 
the following property: whenever P is nonempty, the Ehrhart quasi- 
polynomial fp{n) is "almost always" strictly saturated. Then there 
exists a polynomial time algorithm for deciding if P contains an integer 
point that works correctly "almost always". 

The meaning of the phrase "almost always" in the context of the decision 
problems in this paper will be specified later (cf. Theorem 13. l.ip . 

It may be remarked that the index as well as the period of the Ehrhart 
quasi-polynomial can be exponential in the bit length of the specification 
of P. In contrast to the polynomial time algorithm above to compute the 
index, the known algorithms to compute the period (e.g. |Wj ) take time 
that is exponential in the dimension of P. It may be conjectured that one 
cannot do much better: i.e., the period, unlike the index here, cannot be 
computed in polynomial time, in fact, even in 2''('^™(^)) time. 

The algorithm in Theorem 11.4.11 is based on the separation-oracle-based 
linear programming algorithm of Grotschel, Lovasz and Schrijver [GLSj . and 
a polynomial time algorithm for computing the Smith normal form |KBj . 

The paradigm of saturated integer programming is useful when one 
knows, a priori, a good estimate for the saturation index of the polytope 
under consideration, or when the saturation index is almost always zero. 
For example, if P is the hive polypolype for the Littlewood-Richardson co- 
efficient (type A), then sie(P) = 0, by the saturation theorem [KTlj . and 
pie(P) = 0, by PH2 (Hypothesis [123]) • For the polytopes P that would 
arise in this paper, sie(P) and pie(P) would in general be nonzero, but con- 
jecturally always small, and sie(P) would conjecturally be almost always 
zero. 
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1.5 Quasi-polynomiality, positivity hypotheses, and 
the canonical models 



The basic goal now is to use Theorem ll.4.1l to get polynomial time algorithms 
to decide nonvanishing, modulo small relaxation, of the structural constants 
in Problems \T7LT\ [TX2l [TX3l and [TX4l with X = G/P or a class variety. 
The main results in this paper which go towards this goal are as follows. 

Quasi-polynomiality 

We associate stretching functions with the structural constants in Prob- 
lems [T]TT]{TTL31 akin to the stretching function c^^(n) in eq. (|l.ip associ- 
ated with the Littlewwod-Richardson coefficient, and show that they are 
quasipolynomials; cf. Chapter HI (But their periods need not be constants, 
as in the case of Littlewood- Richardson coefficients; in fact, they may be 
exponential in general.) In particular, this proves Kirillov's conjecture |Kij 
for the plethysm constants. The proof is an extension of Brion's remarkable 
proof (cf. |Dh| ) of quasi-polynomiality of the stretching function associ- 
ated with the Littlewood-Richardson coefficient. The main ingradient in 
the proof is Boutot's result |Bouj that singularities of the quotient of an 
affine variety with rational singularities with respect to the action of a re- 
ductive group are also rational. This is a generalization of an earlier result 
of Hochster and Roberts [Ho] in the theory of Cohen-Macauley rings. 

Saturation and positivity hypotheses 

Using the stretching quasipolynomials above, we formulate (cf. Section [3. 3p 
analogues of the saturation and positivity hypotheses SH, PH1,PH2,PH3 in 
Section 11.21 for the structural constants in Problems ll.l.HfLLSl and Prob- 
lem [TT31 with X = G/P or a class variety. As for Littlewood-Richardson 
coefficients, it turns out that PH2 implies SH. The hypotheses PHI and SH 
(more strongly, PH2) together imply that the problem of deciding nonvan- 
ishing of the structural constant in any of these problems, modulo a small 
relaxation, can be transformed in polynomial time into a saturated (more 
strongly, positive) integer programming problem, and hence, can be solved 
in polynomial time by Theorem 11.4.11 In particular, this shows that all 
the relaxed decision problems that arise in flip (cf. Hypothesis I1.1.6P have 
polynomial time algorithms, assuming these positivity hypotheses. Though 
these algorithms are elementary, the positivity hypotheses on which their 
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correctness depends turn out to be nonelementary. They are intimately 
linked to the fundamental phenomena in algebraic geometry and the theory 
of quantum groups, as we shall see. 

We also give theoretical and experimental results in support of these 
hypotheses; cf. Chapter |31l6l 

Canonical models 

The proofs of quasi-polynomiality mentioned above also associate with each 
structural constant under consideration a projective scheme, called the canon- 
ical model, whose Hilbert function coicides with the stretching quasi-polynomial 
associated with that structural constant, akin to the model associated by 
Brion |Dh| with the Littlewood-Richardson coefficient. These canonical 
models play a crucial role in the approach to the posivity hypotheses sug- 
gested in Section [L7l 

1.6 The plethysm problem 

We now give precise statements of these results and hypotheses for the 
plethysm problem (Problem ll.l.2p . It is the main prototype in this paper, 
which illustrates the basic ideas. Precise statements for the more general 
Problems 11.1.31 and 11.1.41 appear in Section 13. 3[ 

As for the Littlewood-Richardson coefficients (cf. (jl.ip ). Kirillov |Ki| as- 
sociates with a plethysm constant a^ ^ a, stretching function 

= <l^.^ (1-5) 

and a generating function 

n>0 

(Note that ^ is not stretched in these definitions.) 

He conjectured that ^{t) is a rational function. This is verified here 
in a stronger form: 

Theorem 1.6.1 (a) (Rationality) The generating function ^{t) is ratio- 
nal. 
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(b) (Quasi-polynomiality) The stretching function d'^ ^{n) is a quasi-polynomial 
function ofn. This is equivalent to saying that all poles of ^{t) are roots 
of unity, and the degree of the numerator of ^ [t) is strictly smaller than 
that of the denominator. 

(c) There exist graded, normal C-algebras S = S{a'^^) = (BnSn, o,nd T = 
T[a\^) = ®nTn such that: 

1. The schemes spec{S) and spec{T) are normal and have rational singu- 
larities. 

2. T = , the subring of H -invariants in S, where H = GLn{C) as in 
ProblemUTTM, 

3. The quasi-polynomial d\ ^^{n) is the Hilbert function of T . In other 
words, it is the Hilbert function of the homogeneous coordinate ring of 
the projective scheme Proj{T). 

(d) (Positivity) The rational function A\ ^[t) can be expressed in a positive 
form: 

ho + hit+--- + hdt" 

where a{j) 's and d{j) 's are positive integers, d{j) = d + 1, where d is 
the degree of the quasi-polynomial a^^{n), ho = 1, and hi 's are nonnegative 
integers. 

The specific rings S{a\^) and T{a\^) constructed in the proof of The- 
orem 11.6.11 are very special. We call them canonical rings associated with 
the plethysm constant a\ ^. We call y{a\^ = Proj(5'(a^ ^)), and Z{a\^) = 
Y'io]{T{a\ ^)) the canonical models associated with a\ ^. The canonical rings 
are their homogenous coordinate rings. 

It may be remarked that the analogue of Theorem 1 1 .6. Il (b) for Littlewood- 
Richardson coefficients has an elementary polyhedral proof. Specifically, the 
Littlewood-Richardson stretching function c^^(n) of any type is a quasi- 
polynomial since it coincides with the Ehrhart quasi-polynomial of the BZ- 
polytope |BZ| . Similarly, the analogue of Theorem 1 1.6.1] (d) for Littlewood- 
Richardson coefficients follows from Stanley's positivity theorem for the 
Ehrhart series of a rational polytope (which is implicit in |St3j ). These 
polyhderal proofs cannot be extended to the plethysm constant at this point. 
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since no polyhedral expression for them is known so far-in fact, this is a part 
of the conjectural positivity hypothesis PHI below. In contrast, Brion's 
proof in |Dhj of quasi-polynomiality of c^^(n) can be extended to prove 
Theorem 11.6.11 since it does not need a polyhedral interpretation for ^■ 
But Boutot's result |Bouj that it relies on is nonelementary (because it needs 
resolution of singularities in characteristic zero |Hij . among other things). 
We also give an elementary (nonpolyhedral proof) for Theorem ll.6.1l (a) (ra- 
tionality). But this does not extend to a proof of quasipolynomiality for all 
n, which turns out to be a far delicate problem. It is crucial in the context 
of saturated integer programming. 

Theorem 1.6.2 (Finitely generated cone) 

For a fixed partition fj,, let he the set of pairs (vr, A) such that the 
irreducible representation V-,^{H) of H = GL„(C) occurs in the irreducible 
representation Vx{G) of G = GL[V^{H)) with nonzero multiplicity. Then 

is a finitely generated semigroup with respect to addition. 

This is proved by an extension of Brion and Knop's proof of the analogous 
result for Littlewood-Richardson coefficients based on invariant theory. In 
the case of Littlewood-Richardson coefficients, this again has an elementary 
polyhedral proof [Z] . 

Theorem 1.6.3 (PSPACE) 

Given partitions A, ^, vr, the plethysm constant a\ ^ can be computed in 
poly{{\), in), (vr)) space. 

The main observation in the proof of Theorem 11.6.31 is that the oldest 
algorithm for computing the plethysm constant, based on the Weyl character 
formula, can be efficiently parallelized so as to work in polynomial parallel 
time using exponentially many processors. After this, the result follows from 
the relationship between parallel and space complexity classes. It may be 
remarked that the known algorithms for computing a'^ ^ in the literature- 
e.g., the one based on Klimyk's formula |FH| -take exponential time as well 
as space. 

Theorems II. 6. H 11.6.21 and 11.6.31 lead to the following conjectural sat- 
uration and positivity hypotheses for the plethysm constant. These are 
analogues of PH1,PH2,PH3, SH in Section 11.21 for Littlewood-Richardson 
coefficients. 
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Hypothesis 1.6.4 (PHI) 

For every (A, fi, vr) there exists a polytope P = Px ^ Q such that: 

(1) The Ehrhart quasi-polynomial of P coincides with the stretching quasi- 
polynomial a\ ^{n) in Theorem \1. 6. 1[ (This means P is given by a linear 
system of the form 

Ax < b, (1.7) 

where A does not depend on A and vr and b depends only on A and tt in a 
homogeneous, linear fashion.) In particular, 

al, = HP), (1-8) 

where (j){P) is equal to the number of integer points in P. 

(2) The dimension m of the ambient space, and hence the dimension of P 
as well, and the bitlength of every entry in A are polynomial in the bitlength 
of n and the heights of X and tt. 

(3) Whether a point X S i?™" lies in P can be decided in poly{{X) , (/i), (vr), (x)) 
time. That is, the membership problem belongs to the complexity class P. 
If X does not lie in P, then this membership algorithm also outputs, in the 
spirit of \GLS^ . the specification of a hyperplane separating x from P. 

The first statement here, in particular, would imply a positive, polyhedral 
formula for a^^, in the spirit of the known positive polyhedral formulae for 
the Littlewood- Richardson coefficients in terms of the BZ- jBZj . hive |KTlj 
or other types of polytopes |Dhj . It would also imply polyhedral proofs for 
Theorem 11.6.11 (a), (b), (d), and Theorem 1 1.6. 2 [ Conversely, Theorem 11.6.11 
(a), (b), (d), and Theorem 11.6.21 constitute a theoretical evidence for exis- 
tence of such a positive polyhedral formula. 

The second statement in PHI is justified by Theorem ll.6.3[ Specifi- 
cally, it should be possible to compute the number of integer points in P 
in PSPACE in view of Theorem 11.6.31 If dim(P) and m were exponential, 
then the usual algorithms for this problem, e.g. Barvinok [Bar], cannot be 
made to work in PSPACE. Indeed, it may be conjectured that the number 
of integer points in a general polytope P C R'" can not be computed in 
o(m) space. 

The number of constraints in the hive [KTlj or the BZ-polytope |BZj 
for the Littlewood-Richardson coefficient ^ is polynomial in the number 
of parts of a, f3, A. In contrast, the number of constraints defining may 
be exponential in the (/i) and the number of parts of A and vr. But this is 
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not a serious problem. As long as the faces of the polytope P have a nice 
description, the third statement in PHI is a reasonable assumption. This 
has been demonstrated in |GLSj for the well-behaved polytopes in combina- 
torial optimization with exponentially many constraints. The situation in 
representation theory should be similar, or even better. For example, the 
facets of the hive polytope |KTlj are far nicer than the facets of a typical 
polytope in combinatorial optimization. 

It is known that membership in a polytope is a "very easy" problem. 
Formally, if a polytope has polynomially many constraints, this problem 
belongs to the complexity class NC C P [KRj . the subclass of problems 
with efficient parallel algorithms, which is very low in the usual complexity 
hierarchy. Even if the number of constraints of PJ^ in PHI is exponen- 
tial, the membership problem may still be conjectured to be in NC (cf. 
Remarkrnc)-which would be "very easy" compared to the decision problem 
we began with (Problem II. 1.2p . For this reason, PHI is primarily a mathe- 
matical positivity hypothesis as against PHflip (Hvpothesis II . 1 . 6|) . and the 
positive, polyhedral formula for ^ in (jl.Sp is its main content. 

The remaining positivity hypotheses are purely mathematical. They 
generalize SH,PH2 and PH3 for the Littlewood-Richardson coefficients to 
the plethysm constants. We turn their specification next. We can begin 
by asking if the stretching quasipolynomial cl^ ^{n) is strictly saturated or 
positive. This need not be so. The recent article [Roj shows that strict 
saturation need not hold for the Kronecker coefficients, as was conjectured 
in the earlier version of this paper. A similar phenomenon was also reported 
in |GCT7l IGCTSj . where it was observed that the structural constants of 
the nonstandard quantum groups associated with the plethysm problem (of 
which the Kronecker problem is a special case) need not satisfy an analogue 
of PH2. But it was observed there that the positivity (and hence saturation) 
indices of these structural constants are small, though not always zero; eg. 
see Figures 30,33,35 in |GCT8j . The same can be expected here. This is 
also supported by the experimental evidence in |BOR] where too it may be 
observed that the positivity index is small. Furthermore, in the special case 
(n = 2) of the Kronecker problem analysed in [BQRj . the saturation index 
is zero for almost all Kronecker coefficients. 

These considerations suggest: 
Hypothesis 1.6.5 (SH) 

(a): The saturation index (Definition \1.2.4^ of a\ ^{n) is hounded by a poly- 
nomial in the dimension of G in Problem \l.l.^ and the heights of X and vr. 
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This means there exist absolute nonnegative constants c and c' , independent 
of n, A, fi and vr, such that the saturation index is bounded above by ch^ , 
where h = dimG + ht\ + htir. 

(b): The quasi-polynomial cl\ ^{n) is strictly saturated, i.e. the saturation 
index is zero, for almost all X,fJ., vr. Specifically, the density of the triples 
(A, fi, vr) of total bit length N with nonzero a\ ^ for which the saturation index 
is not zero is less than 1/N^" , for any positive constant c" , as N ^ oo. 

A stronger form of (a) is: 

Hypothesis 1.6.6 (PH2) The positivity index (Definition \1.2.2\) of the 

stretching quasi-polynomial o-x ^{n) is bounded by a polynomial in the di- 
mension of G and the heights of X and vr. 

The following is another stronger form of SH (a). For this, we observe 
that the positive rational form in Theorem 11.6.11 (d) is not unique. Indeed, 
there is one such form for every h.s.o.p. (homogeneous sequence of param- 
eters) of the homogenenous coordinate ring S; the a(j)'s in eq. (|1.6p are the 
degrees of these parameters. 

Kirillov asked if the only possible pole of A'^ ^ is at t = 1-i.e. if ^{n) is 
a polynomial. This is not so (cf. Section [6?2]) . But it may be conjectured that 
the structural constants a(j)'s are small. Specifcally, consider an h.s.o.p. of 
S with a (lexicographically) minimum degree sequence, and call the (unique) 
positive rational form in Theorem ll.6.11 (d) associated with such an h.s.o.p. 
minimal. The modular index ^(a^^^Jof the plethysm constant is defined to 
be the modular index (Definition 11.2. 7( ) of this minimal positive form. Then: 

Hypothesis 1.6.7 (PH3) 

The function ^{t) associated with has a positive rational form 
with modular index bounded by a polynomial in the dimension of G and the 
heights of A and it. 

More specifically, this is so for the minimial positive rational form of 
j4j^(t) as above; i.e., the modular index x{^\ ^ ^■s itself bounded by a poly- 
nomial in the dimension of G and the heights of X and vr. 

This is a conjectural analogue of a stronger form of PH3 for Littlewood- 
Richardson coefficients (Hvpothesis ll.2.6|) . which says that the modular in- 
dex of a Littlewood-Richardson coefficient, defined similarly, is one. PH3 
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here would imply that the period of A'^ ^{t) is smooth-i.e. has small prime 
factors-though it may be exponential in the heights of A, /i, vr. It can be 
shown that PH3 implies SH (a) (Section l3.3p . 

The following result addresses the second arrow in Figure 11.11 in the 
context of the relaxed decision problem for the plethysm constant: 

Theorem 1.6.8 The complexity theoretic positivity hypothesis PHflip (Hy- 
pothesis \1.1.6\) for the plethysm constant is implied by the mathematical 
positivity hypotheses PHI and SH above. Specifically, assuming PHI and 
SH: 

(a) Nonvanishing of a'^f^^ for any b > ch'^' , with c,c',h as in SH, can be 
decided in 0{poly{{X), (/i), (vr), (6))) time. 

(b) There is an 0{poly{{X), (fi), (tt))) time algorithm for deciding if aj^ ^ is 
nonvanishing, which works correctly on almost all X, fi and tt; almost all 
means the same as in SH. 

Here (a) follows by applying Theorem 11.4.11 (2) to the polytope P^ ^ in 
PHI, and letting the positivity index estimate for this polytope be ch^' ; (b) 
follows from Theorem 11.4. II (3). 

Evidence for the positivity hypotheses in special cases 

Littlewood-Richardson coefficients are special cases of (generalized) plethym 
constants. We have already seen that PHI holds in this case, and that there 
is considerable experimental evidence for PH2 and PH3 (Section II. 2p . An- 
other crucial special case of the plethym problem is the Kronecker prob- 
lem (Problem ll.l.ip -in fact, this may be considered to be the crux of the 
plethysm problem. It follows from the results in [GCT9j that PHI holds for 
the Kronecker problem when n = 2; the earlier known formulae [RW^ IRoj 
for the Kronecker coefficient in this case are not positive. It can also be seen 
from the experimental evidence in |BORj that the saturation and positivity 
indices of the Kronecker coefficient, for n = 2, are very small, and almost 
always zero. We also give in Chapter [6] additional experimental evidence for 
PH2 for another basic special case of Problem 11.1.31 with H therein being 
the symmetric group. 
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1.7 Towards PHI, SH, PH2,PH3 via canonial bases 
and canonical models 



In this section, we suggest an approach to prove PHI, SH, PH2 and PH3 for 
the plethysm constant and the analogous hypotheses for the other structural 
constants in Problems 11.1.3^ and 11.1.^ with X = G/P or a class variety. 
In the case of Littlewood-Richardson coefficients of type A, PHI and SH 
have purely combinatorial proofs. But it seems unrealistic to expect such 
proofs of the saturation and positivity hypotheses for the plethysm and 
other structural constants under consideration here given their substantially 
higher complexity. 

The approach that we suggest is motivated by the proof of PHI for 
Littlewood-Richardson coefficients of arbitrary types based on the canonical 
(local/global crystal) bases of Kashiwara and Lusztig for representations of 
Drinfeld- Jimbo quantum groups |Dhl IKas21 IlH ILu2|, ILu4j . By a Drinfeld- 
Jimbo quantum group we shall mean in this paper quantization Gq of a 
complex, semisimple group G as in [RTF] that is dual to the Drinfeld-Jimbo 
quantized enveloping algebra |Drij . Canonical bases for representions of a 
Drinfeld-Jimbo quantum group in type A are intimately linked [GrLj to the 
Kazhdan-Lusztig basis for Hecke algebras |KLH [KL2] . A starting point for 
the approach suggested here is: 

Observation 1.7.1 (PHO) The homogeneous coordinate rings of the canon- 
ical models associated by Brion with the Littlewood-Richardson coefficients 
have quantizations endowed with canonical bases as per Kashiwara and Lusztig. 

This is a consequence of the work of Kashiwara |Kas3j and Lusztig |Lu3l 
ILu4j : see Proposition 14.2.1] for its precise statment. This is why we call the 
models here canonical models. 

We shall refer to the property above as the zeroeth positivity hypothesis 
PHO. Positivity here refers to the deep characteristic positivity property of 
the canonical basis proved by Lusztig: namely its multiplicative and comul- 
tiplicative structure constants are nonnegative. For this reason, we say that 
a canonical basis is positive. Similar positivity property is also known for 
the Kazhdan-Lusztig basis |KL2] . The proofs of these positivity properties 
are based on the Riemann hypothesis over finite fields (Weil conjectures) 
|Dlj and the related work of Beilinson, Bernstein, Deligne [BBDj . 

The property above is called PHO because it implies PHI for Littlewood- 
Richardson coefficients of arbitrary types. Specifically, the latter is a formal 
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consequence of the abstract properties of these canonical bases and is inti- 
mately related to their positivity; cf. Section I4.2.H and \T)h\ IKas21 ILH ILu4j . 
The saturation hypothesis SH in type A |KTlj is a refined property of the 
polyhedral formulae in PHI. In Section |3]2] we suggest an approach to prove 
SH, PH2 and PH3 for arbitrary types based on the properties of these canon- 
ical bases. All this indicates that for the Littlewood- Richardson problem 
PHI, SH, PH2 and PH3 are intimately linked to PHO. 

This suggests the following approach for proving PHI, SH, PH2 and PH3 
for the plethysm and other structural constants under consideration in this 
paper (cf. Section [4. 2. 2p : 

1. Construct quantizations of the homogeneous coordinate rings of the 
canonical models associated with these structural constants, 

2. Show that they have canonical bases in some appropriate sense thereby 
extending PHO to this general setting. 

3. Prove PHI, SH, PH2, and PH3 by a detailed analysis and study of 
these canonical bases as per this extended PHO, just as in the case of 
Littlewood- Richardson coefficients. 

Pictorially, this is depicted in Figure [L2l 

Quantizations of the homogeneous coordinate rings of the canonical 
models associated with Littlewood-Richardson coefficients and their posi- 
tive canonical bases are constructed using the theory Drinfeld-Jimbo quan- 
tum group. In type A, it is intimately related to the theory of Hecke al- 
gebras. But, as expected, the theories of Drinfeld-Jimbo quantum groups 
and Hecke algebras do not work for the plethysm problem. What is needed 
is a quantum group and a quantized algebra that can play the same role 
in the plethysm problem that the Drinfeld-Jimbo quantum group and the 
Hecke algebra play in the Littlewood-Richardson problem. These have been 
constructed in |GCT4j for the Kronecker problem (Problem ll.l.ip and in 
[GCT7j for the generalized plethysm problem (Problem I1.1.2P . We shall call 
them nonstandard quantum groups and nonstandard quantized algebras; cf. 
Section 14.31 for their brief overview. In the special case of the Littlewood- 
Richardson problem, these specialize to the Drinfeld-Jimbo quantum group 
and the Hecke algebra, respectively. The article |GCT8j gives conjecturally 
correct algorithms to construct canonical bases of the matrix coordinate 
rings of the nonstandard quantum groups and of nonstandard algebras that 
have conjectural positivity properties analogous to those of the canonical 
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Construction of quantizations of the coordinate rings of canonical models 



i 

Construction of canonical bases for these quantizations (PHO) 



i 

Positivity and saturation hypotheses PHI, SH 



i 

Polynomial-time algorithms for the relaxed decision problems 



Figure 1.2: Pictorial depiction of the approach 

(global crystal) bases, as per Kashiwara and Lusztig, of the coordinate ring 
of the Drinfeld-Jimbo quantum group, and the Kazhdan-Lusztig basis of the 
Hecke algebra. These conjectures lie at the heart of the approach suggested 
here, since they are crucial for the extension of PHO (cf. Figure II. 2p to the 
general setting here. Their verification seems to need substantial extension 
of the work surrounding the Riemann hypothesis over finite fields mentioned 
above. 

1.8 Basic plan for implementing the flip 

The main application of the results and hypotheses in this paper in the 
context of the flip is the following result. As mentioned in Section [l.ll and 
described in more detail in Sections |7. 6117.71 each lower bound problem, such 
as the P vs. NP problem over C, is reduced in |(^(]T1[ [GCT2] to the prob- 
lem of proving obstructions to embeddings among the class varieties that 
arise in the problem. In Chapter [7] we define a robust obstruction, which is 
an obstruction that is well behaved with respect to relaxation, and whose 
validity (correctness) depends only on an appropriate PHI but not SH. It is 
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conjectured that in each of the lower bound problems under consideration, 
robust obstructions exist (Section I7.6.6p . In the lower bound problems un- 
der consideration, ultimately one is only interested in proving existence of 
obstructions. So one may as well search for only robust obstructions. 

Theorem 1.8.1 (cf. Chapter^ Consider the P vs. NP or the NC vs. 

p#P problem over C IGCTlf . Assume that the homogeneous coordinate 
rings of the relevant class varieties \GCT1\ \ GCT^ in this context have ra- 
tional singularities. Also assume that the structural constants associated 
with these class varieties satisfy analogous PHI as specified in Chapter^ 
Then: 

(a) The problem of verifying a robust obstruction in each of these problems 
belongs to P, so also the relaxed form of the problem of verifying any ob- 
struction (not necessarily robust). 

(b) There exists an explicit family of robust obstructions in each of these 
problems assuming an additional hypothesis OH specified in Chapter^ the 
meaning of the term explicit is also given there. 

(b) The problem of deciding existence of a geometric obstruction also belongs 
to P, assuming a stronger form of PHI specified in Chapter^ Here geomet- 
ric obstruction is a simpler type of robust obstruction, defined in Chapter^ 
which is conjectured to exist in the lower bound problems under considera- 
tion. 

For a precise statement of this theorem, see Chapter [71 

This theorem needs only PHI, but not SH, which is only needed to 
argue why robust obstructions should exist (Section l7.6.6p . and furthermore, 
it is only needed for Problems ll.l.HfLLSl and not for the GIT Problem 
I1.1.4I Thus PHI is the main positivity hypothesis of GCT in the context 
proving existence of (robust) obstructions for the lower bound problems 
under consideration. 

A basic plan for implementing the flip suggested by the considerations 
above is summarized in Figure [L3l It is an elaboration of Figure [TTTJ Ques- 
tion marks in the figure indicate open problems. 

1.9 Organization of the paper 

The rest of this paper is organized as follows. 
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Negative hypotheses in complexity theory (Lower bound problems) 

The flip 

J 

Positive hypotheses in complexity theory (Upper bound problems) 

Saturated and positive integer programming, and 
the quasi-polynomiality results in this paper 

I 

Mathematical saturation and positivity hypotheses: PH1,SH (PH2,3) 



Construction of the canonical models in this paper, and 
construction of the quantum groups in GCT4,7 

?? 

I 

(PHO): Construction of quantizations of the coordinate 
rings of the canonical models and their canonical bases 



?? 

I 

(?): Problems related to the Riemann Hypothesis over finite 
fields, and their generalizations 



Figure 1.3: A basic plan for implementing the flip 
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In Chapter [2] we describe the basic complexity theoretic notions that we 
need in this paper and describe their significance in the context of represen- 
tation theory. 

In Chapter [31 we give a polynomial time algorithm for saturated integer 
programming (Theorem ll.4.ip . and give precise statements of the results 
and positivity hypotheses for Problems 11.1.31 and 11.1.4] (with X = G/P or 
a class variety) mentioned in Section 11.51 These generalize the ones given 
in Section 11.61 for the plethysm constant. The framework of saturated in- 
teger programming in this paper may be applicable to many other struc- 
tural constants in representation theory and algebraic geometry, such as the 
Kazhdan-Lusztig polynomials (cf. Sections 13. 7p . 

In ChapterlU we prove the basic quasi-polynomiality results-Theorem 11.6.11 
and its generalizations for Problems ll.l.3l and l 1.1.41 We also define canonical 
models for the structural constants under consideration, and briefly describe 
the relevance of the nonstandard quantum groups and the related results in 
KX^TTl l(;(]T8j in the context of quantizing the coordinate rings of 
these canonical models and extending PHO to them (Figure [1.2p . 

In Chapter [U we prove the basic PSPACE results-Theorem 11.6.31 and 
its extensions for the various cases of Problem 11.1.31 

In Chapter[6l we give experimental evidence for the positivity hypotheses 
PH2 and PH3 in some special cases of the Problems ll.l.llfLL4l 

In Chapter [71 we describe an application (Theorem ll.S.ip of the re- 
sults and positivity hypotheses in this paper to the problem of verifying or 
discovering a robust obstruction, i.e., a "proof of hardness" |GCT2j in the 
context of the P vs. NP and the permanent vs. determinant problems in 
characteristic zero. 

1.10 Notation 

We let {X) denote the total bitlength of the specification of X. Here X can 
be an integer, a partition, a classifying label of an irreducible representation 
of a reductive group, a polytope, and so on. The exact meaning of {X) will 
be clear from the context. The notation poly(n) means 0{n"'), for some 
constant a. The notation poly(ni, 712, . . .) similarly means bounded by a 
polynomial of a constant degree in ni,n2, . . .. Given a reductive group H, 
Vx{H) denotes the irreducible representation of H with the classifying label 
A. The meaning depends on H. Thus ii H = GL.„(C), A is a partition and 
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Vx{H) the Weyl module indexed by X, if H = Sm, then A is a partition of 
size |A| = m, and Vx{H) the Specht module indexed by A, and so on. 
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Chapter 2 

Preliminaries in complexity 
theory 

In this chapter, we recah basic definitions in complexity theory, introduce 
additional ones, and illustrate their significance in the context of represen- 
tation theory. 

2.1 Standard complexity classes 

As usual, P, NP and PSPACE are the classes of problems that can be 
solved in polnomial time, nondeterministic polynomial time, and polyno- 
mial space, respectively. The class of functions that can be computed in 
polynomial time (space) is sometimes denoted by FP (resp. FPSPACE). 
But, to keep the notation simple, we shall denote these classes by P and 
PSPACE again. 

Let SPACE{s{N)) denote the class of problems that can be solved in 
0{s{N)) space on inputs of bit length N; by convention s{N) counts only 
the size of the work space. In other words, the size of the input, which is on 
the read-only input tape, and the output, which is on the write-only output 
tape is not counted. Hence s{N) can be less than the size of the input or the 
output, even logarithmic compared to these sizes. The class space (log (A^)) 
is denoted by LOGSPACE. 

An algorithm is called strongly polynomial |GLSj , if given an input x = 

(xi , . . . , , 
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1. the total number of arithmetic steps (+, *, — and comparisones) in the 
algorithm is polynomial in k, the total number of input parameters, 
but does not depend (x), where (x) = ^^{xi) denotes the bitlength of 

X. 

2. the bit length of every intermediate operand in the computation is 
polynomial in (x). 

Clearly, a strongly polynomial algorithm is also polynomial, let strong P C 
P denote the subclass of problems with strongly polynomial time algorithms. 

The counting class associated with NP is denoted by Specifically, 
a function / : N'' — > N, where N is the set of nonnegative integers, is in #P 
if it has a formula of the form: 

f{x) = f{xi,- ■ ■ ,Xk) ='^x{x,y), (2.1) 

where x is a polynomial-time computable function that takes values or 1, 
and y runs over all tuples such that (y) = poly((x)). The formula (j2.ip is 
called a ^^P-formula. An important feature of a ^P-formula in the context 
of representation theory is that it is positive] i.e., it does not contain any 
alternating signs. 

The formula ()2.ip is called a strong ^^P-formula, if, in addition, / is 
polynomial in k and x is a strongly polynomial-time computable function. 
Let strong ^P be the class of functions with strong ^P-fomulae. 

It is known and easy to see that 

#P C PSPACE. (2.2) 

2.1.1 Example: Littlewood-Richardson coefRcients 

By the Littlewood-Richardson rule [FHj . the coefficient c^^ (cf. Prob- 
lem 11.2. ip in type A is given by: 

<^ = ^x(r), (2.3) 

T 

where T runs over all numbering of the skew shape A/a, and x(^) is 1 if 
T is a Littlewood-Richardson skew tableau of content /?, and zero, other- 
wise. The total number of entries in T is quadratic in the total number of 
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nonzero parts in a, (3,X, and the number of arithmetic steps needed to com- 
pute x(^) is linear in this total number. Hence (|2.3p is a strong ^^P-formula, 
and Littlewood-Richardson function c{a, (5, A) = ^ belongs to strong 
It may be remarked that the character-based formulae for the Littlewood- 
Richardson coefficients are not #P-formulae, since they involve alternat- 
ing signs. But the algorithms based on the these formulae for computing 
Littlewood-Richardson coefficients run in polynomial space. Thus, from the 
perspective of complexity theory, the main significance of the Littlewood- 
Richardson rule is that it puts the problem, which at the surface is only in 
PSPACE, in its smaller subclass (strong) i^P. 

Though the Littlewood-Richardson rule is often called efficient in the 
representation theory literature, it is not really so from the perspective of 
complexity theory. Because computation of ^ using this formula takes 
time that is exponential in both the total number of parts of a, (3 and A, and 
their bit lengths. This is inevitable, since this problem is #P-complete [N] . 
Specifically, this means there is no polynomial time algorithm to compute 
^, assuming P / NP. 

As remarked in earlier, nonzeroness (nonvanishing) of ^ can be decided 
in poly ((a), (A)) time; pM2l [UUTSllKTl] . Furthermore, the algorithm 
in |GCT3j is strongly polynomial; i.e., the number of arithemtic steps in 
this algorithm is a polynomial in the total number of parts of a, (5, A, and 
does not depend on the bit lengths of a, /3, A. Hence the problem of deciding 
nonvanishing of ^ (type A) belongs to strong P. 

The discussion above shows that the Littlewood-Richardson problem is 
akin to the problem of computing the permanent of an integer matrix with 
nonnegative coefficients. The latter is known to be ^P-complete but 
its nonvanishing can be decided in polynomial time, using the polynomial- 
time algorithm for finding a perfect matching in bipartite graphs |Scj . If 
the positivity hypotheses in this paper hold, the situation would be similar 
for many fundamental structural constants in representation theory and 
algebraic geometry in a relaxed sense. 

2.2 Convex #P 

Next we want to introduce a subclass of ^P called convex ij^P. 

Given a polytope P ^ R\ let xp denote the characteristic (membership) 
function of P: i.e., xpiv) = !> if 2/ £ -P) and zero otherwise. We say that 
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/ = f{x) = f{xi, . . . ,Xk) has a convex T^P-formula if, for every x € Z'^, 
there exists a convex polytope (or, more generahy, a convex body) P^; C M^, 
such that 

1. The membership function XPxiv) can be computed in poly((x), (y)) 
time, each integer point in has 0(poly((x))) bitlength, and 

2. 

/(x) = ,/.(P,), (2.4) 
where (j){Px) denotes the number of integer points in Px. Equivalently, 

/(^) = Ex^^(2^)' (2.5) 

where y runs over tuples in of poly((2;)) bitlength, and XPx denotes 
the membership function of the polytope Px- 

Equation (j2.5p is similar to eq. (j2.ip . The main difference is that x is now 
the membership function of a convex polytope. Clearly, eq. (j2.5p . and hence, 
eq. (|2.4p is a ^P- formula, when xp^ can be computed in polynomial time. 
Let convex ^P be the subclass of #P consisting of functions with convex 
T^P-formulae. 

We say that eq. (j2.4p is a strongly convex T^^P-formula, if the character- 
istic function of Px is computable in strongly polynomial time. Let strongly 
convex ^P be the subclass of #P consisting of functions with strongly con- 
vex 7^/:P-formulae. 

We do not assume in eq. (j2.4p that the polytope Px is explicitly specified 
by its defining constraints. Rather, we only assume, following [GLS] . that 
we are given a computer program, called a membership oracle, which, given 
input parameters x and y, tells whether y £ Px in poly((x), (y)) time. 

If the number of constraints defining Px is polynomial in (x), then it 
is possible to specify Px by simply writing down these constraints. In this 
case the membership question can be trivially decided in polynomial time-in 
fact, even in LOGSPACE-by verifying each constraint one at a time. This 
would not work if Px has exponentially many constraints. In good cases, 
it is possible to answer the membership question in polynomial time even 
if Px has exponentially many facets. Many such examples in combinatorial 
optimization are given in |GLSj . One such illustrative example in repre- 
sentation theory is given in Section I2.2.2[ The polytopes that would arise 
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in the plethysm and other problems of main interest in this paper are also 
expected to be of this kind. 

We now illustrate the notion of convex with a few examples in rep- 
resentation theory. 

2.2.1 Littlewood-Richardson coefRcients 

A geeneralized Littlewood-Richardson coefficient ^ for arbitrary semisim- 
ple Lie algebra (Problem II. 2. ip has a strong, convex ^P- formula, because 

where ^ is the BZ-polytope [BZj associated with the triple (a,/3, A). 
It is easy to see from the description in |BZ| that the number of defin- 
ing constraints of P^ ^ is polynomial in the total number of parts (coor- 
dinates) of a, /3, A. Given q, /3, A, these constraints can be computed in 
strongly polynomial time. Hence, the membership problem for -P^^ belongs 
to LOGSPACE C P. It follows that the Littlewood-Richardson function 
c(a, A) = ^ belongs to strongly convex 

2.2.2 Littlewood-Richardson cone 

We now give a natural example of a polytope in representation theory, the 
number of whose defining constraints is exponential, but whose membership 
function can still be computed in polynomial time. 

Given a complex, semisimple, simply connected group G, let the Littlewood- 
Richardson semigroup LR{G) be the set of all triples (a, /3, A) of dominant 
weights of G such that the irreducible module Vx{G) appears in the tensor 
product Va (G) (X) Vp (G) with nonzero multiplicity [Z] . Brion and Knop [Elj 
have shown that LR{G) is a finitely generated semigroup with respect to 
addition. This also follows from the polyhedral expression for Littlewood- 
Richardson coefficients in terms of BZ-polytopes [Z]. Let LR^{G) be the 
polyhedral cone generated by LR{G). 

When G = GLn{C), the facets of LR^{G) have an explicit description by 
the affirmative solution to Horn's conjecture in [K HIKTl] . But their number 
can be quite large (possibly exponential). Nevertheless, membership of any 
rational (a,/?. A) (not necessarily integral) in LR^{G) can be decided in 
strongly polynomial time. 
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This is because LR^{G) is the projection of a polytope P{G), the num- 
ber of whose constraints is polynomial in the heights of a,/3, A [Z]. If 
(j) '■ P{G) LR{G) is this projection, we can choose P{G) so that for 
any integral (a,/3, A), (p"^{a, f3, X) is the BZ-polytope associated with the 
triple (a, f3, A). To decide if (a, /?, A) S LR{G), we only have to decide if the 
polytope (/)~^(a, (3, A) is nonempty. This can be done in strongly polynomial 
time using Tardos' linear programming algorithm [Taj . 

2.2.3 Eigenvalues of Hermitian matrices 

Here is another example of a polytope in representation theory with expo- 
nentially many facets, whose membership problem can still belong to P. 

For a Hermitian matrix A, let X{A) denote the sequence of eigenvalues 
of A arranged in a weakly decreasing order. Let HE,- be the set of triple 
(a,/3,A) G W such that a = X{A + B), 13 = X{A), X = X{B) for some 
Hermitian matrices A and B of dimension r. It is closely related to the 
Littlewood- Richardson semisgroup LR^ = LR{GLr{C)): HE^ H P^ = LRr, 
where Pr is the semigroup of partitions of length < r. I. M. Gelfand asked 
for an explicit description of HEr- Klyachko |K1] showed that HE^ is a 
convex polyhedral cone. An explicit description of its facets is now known 
by the affirmative answer to Horn's conjecture. But their number may be 
exponential. Hence, membership in HEr is still not easy to check using this 
explicit description. This leads to the following complexity theoretic variant 
of Gelfand's question: 

Question 2.2.1 Does the mememhership problem for H E^. belong to P? 

Given that the answer is yes for the closely related LR^- = LR{GLr{C)) 
(Section I2.2.2p . this may be so. If HEr were a projection of some polytope 
with polynomially many facets, this would follow as in Section 12.2.21 But 
this is not necessary. For example, Edmond's perfect matching polytope for 
non-bipartite graphs is not known to be a projection of any polytope with 
polynomially many constraints. Still the associated membership problem 
belongs to P [Sc] . 

2.3 Separation oracle 

Suppose P C a convex polytope whose membership function xp is 

polynomial time computable. If xpiu) = for some y G M^, it is natural to 
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ask, in the spirit of |GLSj , for a "proof" of nonmembership in the form of a 
hyperplane that separates y from P. 

In this paper, we assume that all polytopes are specified by the separation 
oracle. This is a computer program, which given y, tells if y € P, and if 
y ^ P, returns such a separting hyperplane as a proof of nonmembership. We 
assume that the hyperplane is given in the form / = 0, where a linear function 
/ such that P is contained in the half space / > 0, but l{y) < 0. Furthermore, 
we assume that P is a well-described polyhedron in the sense of |GLSj . This 
means P is specified in the form of a triple (xp,n.,(^), where P C M", xp 
is a program for computing the membership function given y S M", and 
there exists a system of inequalities with rational coefficients having P as 
its solution set such that the encoding bit length of each inequality is at 
most <j). We define the encoding length {P) of P as n + We also assume 
that the separation oracle works in 0(poly((P), (y)) time. 

For example, the polynomial time algorithm for the membership function 
of the Littlewood- Richardson cone (cf. Section 12.2. 2|) can be easily modified 
to return a separating hyperplane as a proof of nonmembership. 

In what follows, we shall assume, as a part of the definition of a convex 
T^P-formula, that Px in (j2.4p is a well-described polyhedron specified by 
a separation oracle that works in polynomial time with (P^) = poly((x)). 
These additional requirements are needed for the saturated integer program- 
ming algorithm in Chapter [3l 
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Chapter 3 

Saturation and positivity 



In this chapter we describe (Section I3.ip a polynomial time algorithm for 
saturated and positive integer programming (Theorem ll.4.ip . In Section [3.31 
we state the main results and positivity hypotheses for the relaxed forms of 
Problem 1 1 . 1 . 3 1 and Problem [TTL31 with X = G/P or a class variety therein. 
Together they say that these relaxed decision problems can be efficiently 
transformed into saturated (more strongly, positive) integer programming 
problems, and hence can be solved in polynomial time. 

3.1 Saturated and positive integer programming 

We begin by proving Theorem 11.4.11 

Let P C i?" be a polytope given by a separation oracle (Section 12. 3p . 
Let (P) be the encoding length of P as defined in Section 12.31 An oracle- 
polynomial time algorithm |GLS] is an algorithm whose running time is 
0(poly((i-'))), where each call to the separation oracle is computed as one 
step. Thus if the separation oracle works in polynomial time, then such 
an algorithm works in polynomial time in the usual sense. Let (j){P) be 
the number of integer points in P. Let fp{n) = (j){nP) be the Ehrhart 
quasi-polynomial [StlJ of P. Let 1{P) be the least period of fp{n), if P 
is nonempty. Let fi^p{n), 1 < i < 1{P), be the polynomials such that 
fp{n) = fi^p{n) \i n = i modulo 1{P). Let Fp{t) = ^n>Q fp^^)^^ denote 
the Ehrhart series of P. It is a rational function. 

Theorem 3.1.1 (a) The index of fp{n), index{fp), can he computed in 
oracle-polynomial time, and hence, in polynomial time, assuming that the 
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oracle works in polynomial time. Furthermore, if index{fp) ^ (i.e. if P 
is nonempty), then fi^p{n) is not an identically zero polynomial for every i 
divisible by index{fp). 

(b) The saturated, and hence, positive integer programming problem, as de- 
fined in Section \1.4\ can be solved in oracle-polynomial time. Here it is 
assumed that the specification of P also contains the saturation index esti- 
mate sie{P), or the positivity index estimate pie{P), and that the bitlength 
of this estimate is 0{poly{{P))). Given a relaxation parameter c > sie{P) 
(or pie{P)), the problem is to determine if cP contains an integer point in 
0{poly{{P), (c))) time. 

(c) Suppose {Px} is a family of poly topes, indexed by some parameter x, 
with the following property: wherenver P^ is nonempty, the Ehrhart quasi- 
polynomial fp^{n) is "almost always" strictly saturated. Almost always 
means, the density of x 's of bitlength < N, with nonempty Px for which 
fp^{n) is not strictly saturated is less than , for any positive c" , as 
N ^ 0. We also assume that Px is given by a separation oracle that works in 
O{poly{{x))) time, where {x) is the bitlength of x, and {Px) = O{poly{{x))). 

Then there exists a 0{poly{{x))) time algorithm for deciding if Px con- 
tains an integer point that works correctly "almost always"; i.e., on almost 
all X. 

Proof: 
(a): 

Nonemptyness of P can be decided in oracle-polynomial time using the 
algorithm of Grotschel, Lovasz and Schrijver |GLSj (cf. Theorem 6.4.1 
therein). An extension of this algorithm, furthermore, yields a specifica- 
tion of the affine space span(P) containing P if P is nonempty (cf. Theo- 
rems 6.4.9, and 6.5.5 in |GLSj ). Specifically, it outputs an integral matrix 
C and an integral vector d such that span{P) is defined hy Cx = d. This 
final specification is exact, even though the first part of the algorithm in 
[GLSj uses the ellipsoid method. Indeed, the use of simultneous diophan- 
tine approximation based on basis reduction in lattices is precisely to ensure 
this exactness in the final answer. This is crucial for the next step of our 
algorithm. 

If P is empty, index(/p) = 0. So assume that it is nonempty. Let C be 
the Smith normal form of C; i.e., C = ACB for some unimodular matrices 
A and B, where the leftmost principal submatrix of (7 is a diagonal, integral 
matrix, and all other columns are zero. 
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The matrices C, A and B can be computed in polynomial time using 
the algorithm in [KBj . After a unimodular change of coordinates, by letting 
z = B~^x, span(P) is specified by the linear system Cz = d = Ad. The 
equations in this system are of the form: 

CiZi = di, (3.1) 

i < codim(P), for some integers q and di. By removing common factors if 
necessary, we can assume that q and di are relatively prime for each i. Let 
c be the l.c.m. of q's. 

The statement (a) follows from: 

Claim 3.1.2 index{fp) = c and fi^p{n) is not an identically zero polyno- 
mial for every i divisible by c. 

Proof of the claim: Indeed, nP = {nz \ z E P} contains no integer point 
unless c divides n. Hence, it is easy to see that Fp{t) = Fp{t'^), where 
Fp{x) is the Ehrhart series of the dilated polytope P = cP. By eq. (j3.ip . 
the equations defining P are: 

Zi = di{c/ci), (3.2) 

Clearly, c divides the least period 1{P) of /p, and 1{P) = l{P)/c is the period 
of the Ehrhart quasipolynomial fp (n) . It suffices to show that the index of 
fp{n) is one and that fj p{n) is not an identically zero polynomial for every 
1 < j < 1{P). This is equivalent to showing that P contains a point z with 
with Zi = ai/b, for some integers a^'s and b such that b = j modulo 1{P). 
Let us call such a point j-admissible. Because of the form of the equations 
(j3.2p defining span(P), we can assume, without loss of generality, that P is 
full dimensional. This means the system (|3.2p is empty. Then this follows 
from denseness of the set of j-admissible points. This proves the claim, and 
hence (a). 

(b) : Let s = sie(P) be the given saturation index estimate. This means 
fp{n + s) is strictly saturated. This in conjunction with (a) implies that, 
given a relaxation parameter c > s, cP contains an integer point, iff c 
is divisible by index(/p) (by letting n = c — s). This can be checked in 
0(poly((P), (c))) time since index(/p) can be computed in polynomial time 
by (a). 

(c) The algorithm computes index(/p^) and says "Probably Yes" if the index 
is one, and "No" otherwise. Since the saturation index of fp^{n) is zero 
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almost always, by the argument in (b) with s = and c = 1, "Probably 
Yes" really means "Yes" almost always. Q.E.D. 

The algorithm in (c) has one drawback. If the answer is "Probably 
Yes", we have no easy way of checking if really contains an integer point. 
Ideally, we would like an algorithm that says "Yes", with an integer point 
in Px as a proof certificate, or "No", or "Unsure", and the density of x's on 
which it says "Unsure" should be very small. This problem can be overcome 
if the family {Px} has the following stronger property, akin to the family of 
hive polytopes |KTlj : there is a linear function Ix such that, for almost all x, 
if {Px} is nonempty, then the Z^-optimum of Px is integral (this is stronger 
than saying that fp^{n) is strictly saturated). In this case, the algorithm in 
(c) can be extended to yield the integral /^-optimum as a proof certificate. If 
the ia;-optimum is not integeral, the algorithm says "Unsure" . PHI and SH 
(Section ll.6p for the plethysm (and more generally, the subgroup restriction) 
problem may be strengthened by stipulating that the polytopes therein have 
this property. But this is not needed in this paper. 

We note down one corollary of the proof of Theorem 13.1.11 (this should 
be well known): 

Proposition 3.1.3 The rational function Fp{t) = Fp{t^), where Fp[x) is 
the Ehrhart series of the dilated polytope P = cP, and c is the index of 
fp{n). 

If P is explicitly specified in the form a linear system 

Ax < b, (3.3) 

where A is an m x n matrix, b an m vector and m = poly(n), then the 
following stronger version of Theorem 13. l.ll holds. Let (A) and {A,b) denote 
the bitlength of the specification of A and of the linear system (13. 3p . 

Theorem 3.1.4 Suppose P is specified in terms of an explicit linear system 
lis. 3\) . Then the index of the Erhart quasi-polynomial fp{n) can he computed 
in poly {{A, b)) time, using poly{{A)) arithmetic operations. 

Thus, saturated, and hence, positive integer programming problem spec- 
ified in the form \3. 3|) can he solved in in poly{{A, b, c)) time, where c is the 
relaxation parameter, using poly{{A)) arithmetic operations. 

Proof: This is proved exactly as Theorem 13.1.11 but with Tardos' strongly 
polynomial time algorithm for combinatorial linear programming |Taj used 
in place of the algorithm in |GLSj . Q.E.D. 
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3.1.1 A general estimate for the saturation index 



Now we give a general estimate for the saturation index of any polytope P 
with a specification of the form 

Ax < b, (3.4) 

where A is an m x n matrix, m possibly exponential. Let ||P|| = n + -0, 
where iJj is the maximum bitlength of any entry of A. Trivially, ||P|| < (P). 
We do not assume that we know the specification (j3.4|) of P explicitly. We 
only assume that it exists, and that we are told ||P||. Then: 

Theorem 3.1.5 The saturation index of P is 0{2P^^y^\\^\\^). Thus the 
bitlength of the saturation index is 0{poly{\\P\\)). 

Conjecturally, this also holds for the positivity index. This estimate is 
very conservative, but useful when no better estimate is available. 

Proof: There exists a triangulation of P into simplices such that every vertex 
of any simplex is also a vertex of P. Then 

fp{n) = Y.fA{n), 
A 

where A ranges over all open simplices in this triangulation; a zero-dimensional 
open simplex is a vertex. The saturation index of fp{n) is clearly bounded 
by the maximum of the saturation indices of /a(?^)- 

Hence, we can assume, without loss of generality, that P is an open sim- 
plex. Let vq,. . . ,Vn be its vertices. Then, by Ehrhart's result (cf. Theorem 
1.3 in [its]), 

where ho = 1, /ij's are nonnegative, and Oj is the least positive integer 
such that OjVj is integral. By Cramer's rule, the bit length of each Oj is 
poly(||P||). Without loss of generality, we can also assume that Oj's are 
relatively prime. Otherwise, the estimate on the saturation index below has 
to be multiplied by the g.c.d. of Oj's. Then the result follows by applying 
the following lemma to Fp{t), since (aj) = 0(poly(||P||)). Q.E.D. 
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Lemma 3.1.6 Let f{n) be a quasipolynomial whose generating function 
F{t) has a positive form 

where ho = 1, hi 's are nonnegative, and aj 's are positive and relatively 
prime. Let a = max{aj}. Then the saturation index s{f) of f{n) is 
O{poly{a,n)). 

Proof: Let g{n) be the quasi-polynomial whose generating function G{t) = 
^ g{n)t'^ is l/n^=o(-'- ~ t""^)- It is known that this is the Ehrhart quasipoly- 
nomial of the polytope N{ao, . . . ,an) defined by the linear system 

^ajXj = l,Xj > 0. 

The saturation index s{g) of g{n) is bounded by the Frobenius number 
associated with the set of integers {aj}-this is the largest positive integer m 
such that the diophantine equation 



has no positive integeral solution {xq, . . . , It is known (e.g. |BDRj ) that 
the Probenius number is bounded by 

aj + \/aoaia2(ao + oi + 02) = 0(poly(a)), 



assumming that oq < ai . . .. Hence, s{g) = O (poly (a)). 

Since f{n) is a quasi-polynomial, the degree of the numerator of F(t) is 
less than the degree of the denominator. Thus the maximum value of i that 
occurs in ()3.6p is an. 

Let gi{n), i < an, be the quasi-polynomial whose generating function is 
tVn-=o(l-*"0- Then 

s{gi) < i + s{g) = 0(poly(a,n)). 

Since, /ij's in (j3.6p are nonnegative, s{f) = max 5(5(4). The result follows. 
Q.E.D. 
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3.1.2 Extensions 



We now mention a few straightforard extensions of Theorem 13.1.11 

First, it is not necessary that P be a closed polytope. We can allow 
it to be half-closed. Specifically, it can be a solution set of a system of 
inequalitites of the form: 

Aix < bi and A2X < 62, (3-7) 

where we have allowed strict inequalities. The function Fp{n) = (p{nP), the 
number of integer points in nP, is again a quasi-polynomial. Hence, the 
notions of saturation and positivity can be generalized to this setting in a 
natural way. 

Second, the algorithm in Theorem 13.1.11 (b) only needs a nonnegative 
number s{P) such that, for any positive integer c > s{P): 

Saturation guarantee: If the affine span of cP, contains an integer point, 
then cP is guaranteed to contain an integer point. 

If s{P) = sie(P), then this guarantee holds, as can be seen from the 
proof of Theorem 13.1.11 

3.1.3 Is there a simpler algorithm? 

Though the algorithm for saturated integer programming in Theorem 13.1.11 
is conceptually very simple, in reality it is quite intricate, because the work 
of Grotschel, Lovasz and Schrijver |GLS] needs a delicate extension of the el- 
lipsoid algorithm |Kh| and the polynomial-time algorithm for basis reduction 
in lattices due to Lenstra, Lenstra and Lovasz [LLLj . As has been empha- 
sized in |GLSj . such a polynomial-time algorithm should only be taken as a 
proof of existence of an efficient algorithm for the problem under consider- 
ation. It may be conjectured that for the problems under consideration in 
this paper such simple, combinatorial algorithms exist. But for the design 
of such algorithms, saturation alone does not suffice. The stronger property 
(PII3), and more, is necessary. We shall address this issue in Section [3.61 

3.2 Littlewood-Richardson coefficients again 

Theorem 13. 1.41 applied to the BZ-polytope |BZj . with saturation index esti- 
mate equal to zero, specializes to the following in the setting of the Littlewood- 
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Richardson problem (Problem II .2. ip : 



Theorem 3.2.1 \GCT5\l Assuming SH ( Hypothesis \1.2.5\} . nonvanishing of 
c'^p, given a,j3,\, can be decided in strongly polynomial time (Section \2.1\) 
for any semisimple classical Lie algebra Q. 

It is assumed here that a, (3, A are specified by their coordinates in the 
basis of fundamental weights. For type A, this reduces to the result in 
|GCT3j . which holds unconditionly. 

The saturation conjecture for type A arose jZ] in the context of Horn's 
conjecture and the related result of Klyachko [Klj . We now turn to implica- 
tions of Theorem 13 . 2 . 1 1 in this context. 

Given a complex, semisimple, simply connected, classical group G, let 
LR{G) be the Littlewood-Richardson semigroup as in Section 12.2.21 The 
following is a natural generalization of the problem raised by Zelevinsky [Z] 
to this general setting: 

Problem 3.2.2 Give an efficient description of LR{G). 

Zelevinsky asks for a mathematically explicit description. This is a com- 
puter scientist's variant of his problem. 

Let LR^{G) be the polyhedral convex cone generated by LR{G). For 
G = GLn{C), by the saturation theorem, a triple (a,/?. A) of dominant 
weights belongs to LR{G) iff it belongs to LR^{G). Assuming SH (Hy- 
pothesis ll.2.5p . Theorem 13.2.11 provides the following efficient description 
for LR[G) in general. Recall that the period of the Littlewood-Richardson 
stretching polynomial ^ (n) divides a fixed constant d{G) , which only de- 
pends on the types of simple factors of G |DM2l IGCT5j . Let a^'s denote 
the coordinates of a in the basis of fundamental weights. 

Corollary 3.2.3 (a) Assuming SH, whether a given {a,(3,\) belongs to 
LR{G) can be determined in strongly polynomial time. 

(b) There exists a decomposition of LR^[G) into a set of polyhedral cones, 
which form a cell complex C{G), and, for each chamber G in this complex, 
a set M{G) of 0{rank{G)'^) modular equations, each of the form 




[mod d) 



for some d dividing d{G), such that 
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1. SH ( Hypothesis \1.2.^) is equivalent to saying that: (q,/3, A) € LR[G) 
iff {a, (3, X) G LR-^{G) and (q,/3, A) satisfies the modular equations in 
the set M{Ca,i3,x) associated with the cone Ca,i3,x containing a,(3,X. 

2. Given (q,/3, A), whether (q,/3, A) G LR^{G) can be determined in 
strongly polynomial time (cf. Section \1.2.5\) . 

3. If so, the cone Get, 13, X and the associated set M[G^ of modular equa- 
tions can also be determined in strongly polynomial time. After this, 
whether (a,/?, A) satisfies the equations in M{C^p) can be trivially 
determined in strongly polynomial time. 

Proof: (a) is a consequence of Theorem 13.2. 1[ (b) follows from a careful 
analysis of the algorithm therein; see the proof of a more general result 
(Theorem 11X2]) later. Q.E.D. 

We call the labelled cell complex C{G), in which each cell G G C{G) 
is labelled with the set of modular equations M{C), the modular complex, 
associated with LR-^{G). When G = S'L„(C), the modular complex is 
trivial: it just consists of the whole cone LR^{G) with only one obvious 
modular equation attached to it. But, for general G, the modular complex 
and the map C — > M(C) are nontrivial. We do not know their explicit 
description. Corollary 13.2.31 says that, given x = (a,/3,A), whether x G 
LR^{G), and whether the relevant modular equations are satisfied can be 
quickely verified on a computer, though the modular equations cannot be 
easily determined and verified by hand, as in type A. This is the main 
difference between type A and general types. 

This naturally leads to: 

Question 3.2.4 Is there a mathematically explicit description of the mod- 
ular complex C{G) for a general G? 

3.3 The saturation and positivity hypotheses 

Now let f{x), X G N'^, be a counting function associated with a structural 
constant in representation theory or algebraic geometry. Here x denotes 
the sequence of parameters associated with the constant. Let {x) denote 
the bitlength of x. Let ||x|| and rank(x) denote its combinatorial size and 
combinatorial rank-these measure complexity of the nonstretchable part in 
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the specification of x and will be specified later for the /'s of interest in this 
paper. 

For example, in the Littlewood- Richardson problem, x is the triple (q, /?, A), 
f{x) = f{a,(3,X) = c^^, (x) is the total bitlength of the coordinates of 
a,f3, A, ll^ll is the total number of coordinates of a,/3 and A, and rank(2;) = 
||x||. The number of coordinates does not change during stretching, and 
hence, constitute the nonstretchable part of the input specification here. 

Assume that f{x) is nonnegative for all x G N'^, Then we can successively 
ask the following questions: 

1. Does / G PS PACE? That is, can f{x) be computed in poly((x)) 
space? 

2. Does / € #P? (cf. Section EI]) 

3. Does / G convex#P? (cf. Section E^D 

4. Can a stretching function f{x,n) be associated with f{x) intrinsically 
so that f{x, n) is quasi-polynomial? 

5. (PHI?): Is there a polytope Px, for every x, with {P^) = 0(poly((x))) 
and \\Px\\ = 0(poly(||x||)), such that f{x,n) = fp^{n)7 

6. Are there good analogues of SH and/or PH2, PH3 for f{x,n)? If 
so, nonvanishing of /(x), modulo small relaxation, can be decided in 
0(poly((Pa;))) time by Theorem 13. 

In the rest of this paper, we study these questions when / = /(x) is a 
nonnegative function associated with a structural constant in any of the deci- 
sion problems in Section fTTTl Exact specifications of x, (x), ||x|| , rank(x), /(x), 
and /(x,n) for these decision problems are given in Sections 13. 4113. 51 It is 
shown in Chapter [5] that /(x) G PSPACE for Problem ll. 1.21 and the special 
cases of Problem 11.1.31 that arise in the flip. This may be conjectured to be 
so for the /'s in Problem 11.1.41 with X therein a class variety; cf [GCTlOj 
for its justification. Quasipolynomiality of /(x, n) is addressed in ChapterUl 
The hypotheses PHI, SH, PH2, and PH3 in these cases have the following 
unified form. 

Hypothesis 3.3.1 (PHI) Let f = /(x) be the function associated with a 
structural constant in 
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1. Prohlem \l.l.l\ or 

2. [TTE. or 

3. Problem ] 1.1. 'A or 

4- Problem 1.1. 4\ with X being a class variety therein. 



Then the function f{x) has a convex jj^P -formula (cf. {2.4^ ) 

f{x)=<p{P,), 

such that: 

1. for every fixed X, the Ehrhart quasi-polynomial fp^{n) of Px coincides 
with f{x, n). 

2. (P) = 0{poly{P)) and \\P\\ = O{poly{\\x\\)). 
Hypothesis 3.3.2 (SH) 

(a) Suppose f{x) is a structural constant as in PHI above. Then for every x, 
the saturation index s[f) of f{x,n) is 0{poly{rank{x))). This means there 
exist absolute nonnegative constants c,c' such that s{f) < c{rank{x)Y . 

(b) For f{x) in Problems \1. 1.1^1.1.!% the saturation index of f{x,n) is zero- 
i.e., f{x,n) is strictly saturated-for almost all x. This means the density of 
x, with {x) < N and f{x) nonzero, for which the saturation index s{f) is 
nonzero is < l/iV^ , for any positive costant c" , as N ^ oo. 

More strongly than (a), 

Hypothesis 3.3.3 (PH2) Forf{x) as in PHI, the positivity index of f {x , n) 
is 0{poly{rank[x))) . 



Hypothesis 3.3.4 (PH3) For f{x) as in PHI, the generating function 
F{x,t) = f{x,n)t'^ has a positive rational form of modular index O {poly {rank{x))) . 
More specifically, the modular index of f{x,n), as defined in Section \4-l.l\ 
for f's that arise in this paper, is O{poly{rank{x))). 

PH3 implies SH (a); this follows from Lemma 13.1.61 

The following conservative bound follows from Theorem 13.1.51 
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Theorem 3.3.5 (Weak SH) 

Assuming PHI (Hypothesis Icl.cl.l]) . the saturation index of f{x,n) is 
bounded by 2'^(^"'^^(ll^ll)); hence its bitlength is bounded by O{poly{\\x\\)). 

The fohowing result addresses the relaxed forms of the decision problems 
for the structural constants under consideration (cf . Section II. 1|) . 

Theorem 3.3.6 Suppose f{x) is a structural constant as in PHI above. 
Then PHI (Hypothesis \3. 3.1\) and SH (Hypothesis \3. 3.2(1 imply Hypothe- 
sis M.l.^ (PHflip) in this case. Specifically: 

(a) For f{x) in Problems \1.1.1\[1.1.4\ nonvanishing of f{x,a), for a given x 
and a relaxation parameter a > c{rank{x)Y , with c, c' as in Hvpothesis \3. 3.2\. 
can be decided in poly{{x), (a)) time. 

(b) For f{x) as in Problems \ 1.1. 1^1. 1.31 there is a poly{{x)) time algorithm 
for deciding nonvanishing of f{x) that works correctly on almost all x. 

This follows from Theorem 13.1.11 

The following sections give precise descriptions of x, (rc), rank(x) 
and f{x,n) for the structural constants under consideration. 

3.4 The subgroup restriction problem 

In this section we consider the subgroup restriction problem (Problem ll.l.Sp . 
The Kronecker and the plethysm problems (Problems 11.1. 11 ll.l.2|) are its 
special cases. 

Let G, H, p, A, TT, be as in Problem ll.1.31 We shall define below an ex- 
plicit polynomial homomorphism p : H ^ G, as needed in the statement of 
Problem ll.1.31 and also the precise specifications [H], [p], [A], [it] of H, p, A, vr, 
respectively. We shall also define the bitlengths (if), (p), (A), (vr) and the 
combinatorial bit lengths ||A||, ||7r||. We let \\H\\ = (H) and \\p\\ = (p), since 
H and p belong to the nonstretchable part of the input. On the other hand, 
A and vr will be stretched in the definition of /(x,n), and hence their com- 
binatorial bit lengths will differ from the usual bit lengths. The input x in 
the subgroup restriction problem is the tuple {[H], [p], [A], [vr]). Its bitlength 
(x) is defined to be the sum of the bitlengths (H), (p), (A), (vr), and ||x|| is 
defined to be the sum of ||A|| and ||7r||. Finally rank(x) is defined 

to the sum of the ranks of H and G and 11 A 11 and llvrll. Here that rank of 
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a (reductive) group is defined in a standard way. For example, the rank of 
the symmentric group Sn is n, that of GL„(C) is n. The rank of a general 
finite or connected simple group can be defined similarly, and the rank of a 
more complex reductive group is defined to be the sum of the ranks of its 
simple components. With this terminology, we let f{x) = m^, with x as 
defined here in Hypotheses I3.3.H|3T3^ and Theorem 13.3.61 for the subgroup 
restriction problem. Here H and p are implicit in the definition of m^. 

For example, in the plethym problem (Problem ll.l.2p . these specifi- 
cations are as follows. The specification [H] is just the root system for 
H = GLn{C). Its bitlength (H) is n. The specification [p] of the repre- 
sentation map p : H ^ G = GL{y^{H)) consists of just the partition p 
specified in terms of its nonzero parts. Its bitlength (p) = {p). The ranks 
of H and G are as usual. The partitions A and p are specified in terms of 
their nonzero parts. Their bitlength is the total bitlength of the parts, and 
the combinatorial bit length is the total number of parts (the height). It 
is crucial here that only nonzero parts of A are specified, because the rank 
of G can be exponential in the rank of H and the bitlength of p. Hence, 
the bitlength of this compact representation of A can be polynomial in the 
rank of H and the bitlength of p, even if the dimension of G is exponential. 
The main difference between (x) and ||2;|| is that the stretchable data A and 
vr contribute their bitlengths to the former, and their heights to the latter. 
The plethysm problem is the main prototype of the subgroup restriction 
problem. If the reader wishes, (s)he can skip the rest of this subsection and 
jump to Section [3.4.31 in the first reading. 

In general, we assume that H in Problem ll.l.3l is a finite simple group, or 
a complex simple, simply connected Lie group, or an algebraic torus (C*)*^, 
or a direct product of such groups. The results and hypotheses in this paper 
are also applicable if we allow simple types of semidirect products, such as 
wreath products, which is all that we need for the sake of the flip. But these 
extensions are routine, and hence, for the sake of simplicity, we shall confine 
ourselves to direct products. 

3.4.1 Explicit polynomial homomorphism 

Now let us define an explicit polynomial homomorphism. This will be done 
by defining basic explicit homomorphisms, and composing them functorially. 

Basic explicit homomorphisms: 

Let V be an irreducible polynomial representation of H (character- 
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istic zero), or more generally, an explicit polynomial representation that 
is constructed functorially from the irreducible polynomial representations 
using the operations © and 0. Then the corresponding homomorphism 
p : H ^ G = GL(y) is an explicit polynomial homomorphism. The iden- 
tity map H ^ H is also an explicit polynomial homomorphism. 

The polynomiality restriction here only applies to the torus component 
of H. If is a finite simple group, or a complex semisimple group, then 
any irreducible representation of H is, by definition, polynomial. In general, 
a representation is polynomial if its restriction to the torus component is 
polynomial; i.e., a sum of polynomial (one dimensional) characters. 

To see why the polynomiality restriction is essential, let H he a, torus, 
V its rational representation, and G = GL{V). Let Vx{G) = Sym'^(F), 
the symmetric representation of G, and let vr be the label of the trivial 
character of H. Then the multiplicity is the number of //-invariants in 
Sym'^(y). This is easily seen to be the number of nonnegative solutions of a 
system of linear diophontine equations. But the problem of deciding whether 
a given system of linear diophontine equations has a nonnegative solution 
is, in general, A^P-complete. Though the system that arises above is of a 
special form, it is not expected to be in P if y is allowed to be any rational 
representation; the associated decision problem may be A^P-complete even 
in this special case. If is a polynomial representation of a torus H, then 
all coefficients of the system are nonnegative, and the decision problem is 
trivially in P. 

Composition: 

We can now compose the basic explicit (polynomial) homomorphisms 
above functorially: 

1. li Pi : H ^ Gi are explicit, the product map p : H ^ Y\i Gi is also 
explicit. 

2. If Pi : Hi ^ Gi are explicit, the product map p -WHi ^WGi is also 
explicit. 

Instead of products, we can also allow simple semi-direct products such 
as wreath products here. We may also allow other functorial constructions 
such as induced representations and restrictions. For example, li p : H ^ G 
is an explicit polynomial homomorphism, and G' C G is an explicit subgroup 
of G such that p{H) C G' , then the restricted homomorphism p' : H ^ G' 
can also be considered to be an explicit polynomial homomorphism. But 
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for the sake of simplicity, we shall confine ourselves to the simple functorial 
constructions above. 

3.4.2 Input specification and bitlengths 

Now we describe the specifications [H], [p], [A], [fj], their bitlengths. These 
are very similar to the ones in the plethysm problem. 

The specification [H]: 

We assume that H is specified as follows. 

(1) If is a complex, simple, simply connected Lie group, then the specifica- 
tion [H] consists of the root system of H or the Dynkin diagram. Let (H) be 
the bitlength of this specification. Thus, ii H = S'L„(C), then (H) = 0{n). 

(2) If is a simple group of Lie type (Chevalley group) then it has a similar 
specification [Caj . The only finite groups of Lie type that arise in GCT are 
SLn{Fpk) and GLn{Fpk). In this case the specification [H] is easy: we only 
have to specify n,p, k. We define (H) in this case to be n + A; + log2P; not 
log2 n + log2 k + log2 n. As a rule, (H) is defined to be the sum of the rank 
parameters (such as n and k here) and bit lengths of the weight parameters 
(such as p here) in the specification. This is equivalent to assuming that the 
rank parameters are specified in unary. 

(3) If H is the alternating group An, we only specify n. Let (H) = n. 

(4) The torus is specified by its dimension. We define {H) to be the dimen- 
sion. 

(5) If is a product of such groups, its specification is composed from the 
specifications of its factors, and the bitlength {H) is defined to be the sum 
of the bitlengths of the constituent specifcations. 

The specification [p\: 

Let us first assume that p is a basic explicit polynomial homomorphism. 
In this case the specification oi p : H —> G = GLiV) is a pair [p] = {[H], \V]) 
consisting of the specification [H] of H as above, and the combinatorial 
specification \V] of the representation V as defined below: 

(1) If is a semisimple, simply connected Lie group, and V = V^{H) its 
irrreducible representation for a dominant weight p of H, then V is specified 
by simply giving the coordinates of p in terms of the fundamental weights 
of H. Thus \V] = p, and its bitlength {V) is the total bitlength of all 
coordinates of p, and the combinatorial bit length \\V\\ is the total number 
of coordinates of p. 



55 



(2) If if = 5„, and V = Sj its irreducible representation (Specht module), 
then [V] is the partition 7 labelling this Specht module. We define {V) to 
be the bitlength of this partition, and = {V). 

(3) If ii is a finite general linear group GLn{Fpk), and V its irreducible rep- 
resentation, as classified by Green |Mcj . then [V] is the combinatorial clas- 
sifying label of V as given in |Mcj . It is a certain partition- valued function, 
which can be specified by listing the places where the function is nonzero 
and the nonzero partition values at these places. Let {V) be the bitlength 
of this specification; it is 0(poly(?i, k, (p))). We let ||y|| = (V). More gener- 
ally, if ii is a finite group of Lie type, and V its irreducible representation, 
then [V] is the combinatorial classifying label of V as given by Lusztig |Lulj . 

(4) If is a torus and V is a polynomial character, then [V] is the speci- 
fication of the character. Its bitlength is the bitlength of the specification, 
and combinatorial bit length is the dimension of H. 

(5) If V is composed from irreducible representations, then [V] is composed 
from the specifications of the irreducible representations in an obvious way. 
Bitlengths and combinatorial bitlengths are defined additively. 

The bitlength (p) is defined to be (H) + (V), where (V) is the bitlength 
of [V]. 

If p is a composite homomorphism, its specification [p] is composed from 
the specifications of its basic constituents in an obvious way. The bitlength 
(p) is defined to be the sum of the bitlengths of these basic specifications. 

The specifications [A] and [vr]: 

V^(ff) is the tensor product of the irreducible representations of the 
factors of H. We let [vr] be the tuple of the combinatorial classifying labels 
of each of these irreducible representations, as specified above. Let (vr) be 
their total bit length, and ||7r|| the total combinatorial bit length. Similarly, 
V\ (G) is the tensor product of the irreducible representations of the factors 
of G. When G = GLm{C), A is a partition, which we specify by only giving 
its nonzero parts, whose number is equal to the height of A. This is crucial 
since the height of A can be much less than than the rank m of G, as in 
the plethysm problem (Problem ll.l.2|) . We shall leave a similar compact 
specification [A] for a general connected, reductive G to the reader. Let (A) 
be its bitlength and ||A|| its combinatorial bit length. 
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3.4.3 Stretching function and quasipolynomiality 

Let f{x) = in^ as above, with x = ([i^], [p], [A], [vr]). Here A is the dominant 
weight of G. First, assume that H is connected, reductive. Then vr is the 
dominant weight of H. For a given x, let us define the stretching function 
as 

f{x,n)=ml[n)=mll, (3.8) 

which is the multiphcity of VmviH) in Vn\{G)^ considered as an if-module 
via p : H ^ G. Let M'^{t) = X]„>o ^a('^)*"^ generating function of 

this stretching quasi-polynomial. 

The following is the generalization of Theorem 11.6.11 in this setting. 

Theorem 3.4.1 (a) (Rationality) The generating function M^(t) is ratio- 
nal. 

(h) (Quasi-polynomiality) The stretching function rh'^{n) is a quasi-polynomial 
function of n. 

(c) There exist graded, normal C-algebras S = S{m'^) = (BnSn <ind T = 
T{m'^) = (BnT-n such that: 

1. The schemes spec{S) and spec(T) are normal and have rational singu- 
larities. 

2. T = , the subring of H -invariants in S. 

3. The quasi-polynomial ■m^{n) is the Hilbert function ofT. 

(d) (Positivity) The rational function M^{t) can be expressed in a positive 
form: 

w = ""rt!^^'^';;^^^ (3-9) 

where a{j) 's and d{j) 's are positive integers, = d+1, where d is the 

degree of the quasi-polynomial, h^ = 1, and hi's are nonnegative integers. 

The specific rings S{m'^) and T{m'^) constructed in the proof of this 
result are called the canonical rings associated with the structrural con- 
stant m^. The projective schemes Y{m'^) = Proj(5(m^)), and Z{m'^) = 
Proj (T(m^)) are called the canonical models associated with m^. 

Theorem 13.4.11 and its generalization, when H can be disconnected, is 
proved in Chapter HI cf. Theorem 14.1.11 
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Finitely generated semigroup 

The following is an analogue of Theorem ll.6.2[ 

Theorem 3.4.2 Assume that H is connected. For a fixed p : H ^ G, let 
T{H, G) he the set of pairs {p, A) of dominant weights of H and G such that 
the irreducible representation V.,^{H) of H occurs in the irreducible repre- 
sentation V\{G) of G with nonzero multiplicity. Then T{H,G) is a finitely 
generated semigroup with respect to addition. 

This is proved in Section [4.4[ 
PSPACE 

The following is a generalization of Theorem ll.6.3[ 

Theorem 3.4.3 Assume that H in Problem \1.1.3\ is a direct product, whose 
each factor is a complex simple, simply connected Lie group, or an alternat- 
ing (or symmetric) group, or SLn,{Fpk) (or GLn{Fpk)), or a torus. Then 
f{x) = m\ can he computed in poly[{x)) space, with x as specified above. 

This is proved in Chapter [5l It may be conjectured that Theorem 13.4.31 
holds even when the composition factors of H are allowed to be general 
finite simple groups of Lie type. This will be so if Lusztig's algorithm |Lu5| 
for computing the characters of finite simple groups of Lie type can be 
parallelized; cf. Section [531 

Positivity hypotheses 

Theorem 13.4.111??^?^ along with the experimental results in special cases 
(cf. Chapter [6|), constitute the main evidence in support of the positivity 
Hypotheses 13.3. HlHT^?^ for the subgroup restrition problem. 

3.5 The decision problem in geometric invariant 
theory 

Finally, let us turn to the most general Problem 11.1.41 
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3.5.1 Reduction from Problem 11.1.31 to Problem 11.1.41 



First, let us note that the subgroup restriction problem (Problem I1.1.3P 
is a special case of Problem 11.1.41 To see this, let H, p and G be as in 
Problem ll.1.31 and let X be the closed G-orbit of the point v\ corresponding 
to the highest weight vector of V\{G) in the projective space PiVxiG)). Then 

X = Gvx = G/Px, (3.10) 

where the P = P\ = G^^ is the parabolic stabilizer of v\. We have a natural 
action of H on X via p. Let R be the homogeneous coordinate ring of X. By 
[Ha^ IMRl \Rm\ ISm] . the singularities of spec(i?) are rational. By Borel-Weil 
[FHj . the degree one component Ri of the homogeneous coordinate ring R 
of X is V\{G). Hence, in this special case of Problem ll.l.4l is precisely 
in Problem ll.l.3[ The results in Section 13.41 for sj generalize in a natural 
way for sj. 

3.5.2 Input specification 

The variety X in the above example is completely specified by H, p and A. 
Hence its specification [X] can be given in the form a tuple {[H], [p], [A]), 
where [H], [p] and [A] are the specifications of H, p and A as in Section [331 
The input specification x for Problem II. 1.41 in the special case above is the 
tuple {[X], d, [vr]) = {[H], [p], [A], d, [vr]), where [vr] is the specification of vr as 
in Section [331 

We now describe a class of varieties X which have similar compact spec- 
ifications. 

Let G be a connected, reductive group, H a reductive, possibly discon- 
nected, reductive group, and p : H ^ G an explicit polynomial homomor- 
phism as in Section [3^ Let V = Vx{G) be an irreducible representation of G 
for a dominant weight A. Let P{V) be the projective space associated with 
V. It has a natural action of H via p. Let v € PiV) be a point that is char- 
acterized by its stabilizer G^ C G. This means it is the only point in P{V) 
that is stabilized by G„. For example, the point vx above is characterized by 
its parabolic stabilier. We assume that we know the Levi decompositioon of 
G„ explicity, and its compact specification [G„], like that of H, and also an 
explicit compact specification of the embedding p' : G^ G, aking to that 
of the explicit homomorphism p : H ^ G. Let X C P{V) be the projective 
closure of the G-orbit of v in P{V). Then X as well as the action of H on 
X are completely specified by X,H,p,Gi, and p' . Hence, we can let [X] be 
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the tuple (A, [H], [p], [Gy], [p'])- The input specification x for Problem 11.1.41 
with the X of this form is the tuple ([X], d, [vr]). The bitlengths (x) and ||x|| 
are defined additively. The rank(x) is defined to be the sum of the ranks of 
H and G, dim{V) and ||7r||. Since the point vx above is characterized by its 
stabilizer, G/P is a variety of this form. 

The class varieties |GCTll IGCT2j are either of this form, or a slight ex- 
tension of this form, and admit such compact specifications. The algebraic 
geometry of an X of the above form is completely determined by the repre- 
sentation theories of the two homomorphisms p : H ^ G and p' : Gy ^ G. 
Furthermore, the results in |GCT2j say that Problem 11.1.41 for a class variety 
is intimately linked with the subgroup restriction problem and its variants 
for the homomomorphisms p and p'. Hence it is qualitatively similar to the 
subgroup restriction problem in this case; cf. [GCTlOj for further elabora- 
tion of the connection between these two problems. 

3.5.3 Stretching function and quasi-polynomiality 

Now let H,X,R and be as in Problem 11.1.41 with H therein assumed to 
be connected. We associate with /(x) = the following stretching fucntion: 

f{x,n) = s-,{n)=sZ, (3.11) 

where is the multiplicity of the irrreducible representation Vnn{H) of H 
in Rnd, the componenent of the homogeneous coordinate ring R of X with 
degree nd. Let S{t) = En>o^S(")*"- 

Theorem 3.5.1 Assume that the singularities of spec{R) are rational. 

(a) (Rationality) The generating function S^{t) is rational. 

(h) (Quasi-polynomiality) The stretching function s^{n) is a quasi-polynomial 
function of n. 

(c) There exist graded, normal C-algebras S = S{s'^) = OnSn o-iT'd T = 
r(sj) = (BnTn such that: 

1. The schemes spec{S) and spec{T) are normal and have rational singu- 
larities. 

2. T = , the subring of H -invariants in S. 

3. The quasi-polynomial s'^{n) is the Hilbert function ofT. 
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(d) (Positivity) The rational function S^{t) can be expressed in a positive 
form: 



- ho + hit + --- + hkt^ 

where a{j) 's and k{j) 's are positive integers, k{j) = k + 1, where k is 
the degree of the quasi-polynomial s^{n), Hq = 1, and hi's are nonnegative 
integers. 

This is proved in Chapter SI Theorem 13.4. II is a special case of this theorem, 
in view of the reduction in Section 13.5.11 Theorem 13.5.11 is applicable when 
X is a class variety, assuming that its singularities are rational. 



3.5.4 Positivity hypotheses 

Even though Theorem 13.5.11 holds for any X, with spec(i?) having ratio- 
nal singularities, the positivity hypotheses PHI, SH, PH2, and PH3 can 
be expected to hold for only very special X's. In general, characterizing 
the X's with compact specification for which these hypotheses hold is a 
delicate problem. Hypotheses l3.3.1ll3A^ say that these hold when X in 
Problem ll.l.4l is G/P (as in Section [3. 5. ip or a class variety, with the input 
specification x as described above. For future reference, we shall reformulate 
these hypotheses purely in geometric terms. 

For this we need a definition. 

Let T = Tn be a graded complex C-algebra so that the singularities 
of spec(r) rational. Let Z = Proj(T). Assume that Z has a compact 
specification [Z]; we shall specify it below for the Z^s of interest to us. 
We let [T], the specification of T, to be [Z]. This will play the role of 
the input in the definition below. Let (T) denote its bitlength, and ||T|| 
combinatorial bit length. Let hxin) = dim(T„) be its Hilbert function, 
which is a quasipolynomial, since the singularities of spec(T) are rational; 
cf. Lemma 14.1.31 

Definition 3.5.2 We say that PHI holds for T (or Z) if the Hilbert quasi- 
polynomial hxin) is convex. This means there exists a polytope P = Pt 
depending on the input [T], whose Ehrhart quasipolynomial fp{n) coincides 
with the Hilbert function hxin), and whose membership function Xpiu) can 
be computed in poly{{T),y) time. We assume that a separating hyperplane 
can also be computed in polynomial time if y ^ P (Section \2. 
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If PHI holds we can also ask if analogues of SH, PH2, and PH3-whose 
formulation is similar and hence omitted-hold. 



3.5.5 G/P and Schubert varieties 

Let us illustrate this definition with an example. Let X = G/P\ be as in 
Section 13.5.11 and R its homogeneous coordinate ring. We have already seen 
that it has a compact specification: namely [X] = A. Since singularities 
of spec(i?) are rational, PHI makes sense. For G/P it follows from the 
Borel-Weil theorem. The Hilbert series of R is of the form 

hQ + --- + hdf^ 
(1 - tY+^ ' 

with /iQ = 1 and /ij's nonnegative. This is so because R is Cohen-Macauley 
|Rm| and is generated by its degree one component. Hence, the modular 
index of the Hilbert function is one (PH3). PH2 turns out to be nontriv- 
ial. Experimental evidence in its support for the classical G/P is given in 
Section 16.31 Considerations for the Schubert subvarieties are similar. Ex- 
perimental evidence for PH2 for the classical Schubert varieties is also given 
in Section 16.31 

Now let s = s J be the multiplicity as Problem 11.1.41 with X having a 
compact specification [X] as above. Let T = T[s) be the ring associated 
with s as in Theorem 13.5.11 (c). Let Z = Z{s) = Proj(r). We let the 
specification [Z] = vr). Let {Z) be its bitlength. 

So Theorem 13. 1 . 1 1 in this context implies: 



Theorem 3.5.3 // PHI and SH holds for Z(s) then nonvanishing of s, 
modulo small relaxation, can be decided in poly{{Z)) time. 



We also have the following reformulation: 



Proposition 3.5.4 Hypothesesl3JJll{M^are equivalent to PHI, SH,PH2,PH3 
for Z{s), where s is a stucture constant that corresponds the structure con- 
stant f{x) in Hupotheses \3. 3. 1\ Thus, in the case of the subgroup restriction 
problem, s = = m\ as in Section \3. 5.1[ 



This is just a consequence of definitions. 
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3.6 PH3 and existence of a simpler algorithm 



As we remarked in Section 13.1.31 the use of the ehipsoid method and basis 
reduction in lattices makes the the algorithm for saturated integer program- 
ming (cf. Theorem I3.1.ip fairly intricate. For the flip (cf. [GCTflip] and 
Chapter [7]), it is desirable to have simpler algorithms for the relaxed forms 
of the decision problems under consideration, akin to the the polynomial 
time combinatorial algorithms in combinatorial optimization [Sc] that do 
not rely on the elliposoid method or basis reduction. We briefly examine in 
this section the role of PH3 in this context. 

The simple combinatorial algorithms in combinatorial optimization work 
only when the problem under consideration is unimodular-in which case the 
vertices of the underlying polytope P are integral-or almost unimodular- 
e.g. when the vertices of P are half integral. Edmond's algorithm for finding 
minimum weight perfect matching in nonbipartite graphs [Sc] is a classic 
example of the second case. 

In the unimodular case, Stanley's positivity result [Stlj implies that the 
rational function Fp{t) has a positive form 



Fp{t) 



h{d)t'^ + ■■■ + h{0) 



[l-t 



\d+l 



If PH3 (Hypothesis 13.3.4]) holds for a structural function /(x) under con- 
sideration then the Ehrhart series Fp^ (t) of the polytope Px associated with 
X in PHI (Hypothesis 13.3. ip has a minimal positive form in which each root 
of the denominator has 0(poly(||x||)) order. Roughly, this says that the 
situation is "close" to the unimodular case. Hence, in such a case we can 
expect a purely combinatorial polynomial-time algorithm for deciding non- 
vanishing of f{x), modulo small relaxation, that does not need the ellipsoid 
method or basis reduction. 



3.7 Other structural constants 

The paradigm of saturated and positive integer programming in this paper, 
along with appropriate analogues of PH1,SH,PH2,PH3, may be applicable 
several other fundamental structural constants in representation theory and 
algebraic geometry, in addition to the ones in Problems ll.l.llfLL4l treated 
above, such as 
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1. the value of a Kazhdan-Lusztig polynomial at g = 1, |KLlj : 

2. the values at g = 1 of the well behaved special cases of the parabolic 
Kostka polynomials and their g-analogues |Kij : 

3. the structural coefficients of the multiplication of Schubert polynomi- 
als, and so on. 
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Chapter 4 



Quasi-polynomiality and 
canonical models 

In this chapter we prove quasipolynomiahty of the stretching functions as- 
sociated with the various structural constants under consideration (Sec- 
tion 14. ip , describe the associated canonical models (Section I4.2p , describe 
the role of nonstandard quantum groups in |GCT41 IGCT71 IGCTSj in the 
deeper study of these models (Section I4.3p . prove finite generation of the 
semigroup of weights (Theorem 13.4. 2p (Section I4.4p . and give an elementary 
proof of rationality in Theorem 13.4.11 (a) (Section 14. 5p . 

4.1 Quasi-polynomiality 

Here we prove Theorem I3.5.H Theorems 11.6.11 and 13 . 4 . 1] are its special cases 
in view of the reduction in Section 13.5.11 This, in turn, follows from the 
following more general result. 

Let R = (BkRd be a normal graded C-algebra with an action of a reduc- 
tive group H. Assume that spec{R) has rational singularities. Let Hq be 
the connected component of H containing the identity. Let Hd = H/Hq be 
its discrete component. Given a dominant weight vr of Hq, we consider the 
module K- = ^7r(-f^o)i an //-module with trivial action of Ho- Let denote 
the multiplicity of the i/- module K- in Rd- Let sj(n) be the multiplicity of 
the //-module Vmr in Rnd- This is a stretching function associated with the 
mulitplicity si Let 5J(i) = En>o«l(")*"- 
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Theorem 4.1.1 (a) (Rationality) The generating function S^it) is ratio- 
nal. 

(h) (Quasi-polynomiality) The stretching function s'^{n) is a quasi-polynomial 
function of n. 

(c) There exist graded, normal C-algebras S = S{s'^) = (BnSn o,nd T = 
t[sI) = ®nTn such that: 

1. The schemes spec{S) and spec(T) are normal and have rational singu- 
larities. 

2. T = , the subring of H -invariants in S. 

3. The quasi-polynomial s^(n) is the Hilbert function of T . 

(d) (Positivity) The rational function S^{t) can be expressed in a positive 
form: 

q^(+\ - ho + hit + --- + hkt'' 

where a{j) 's and k{j) 's are positive integers, k{j) = k + 1, where k is 
the degree of the quasi-polynomial s'^in), ho = 1, and hi's are nonnegative 
integers. 

Theorem 13.5.11 follows from this by letting R be the homogeneous coordinate 
ring of X. 

More generally, if W is an irreducible representation of Hjj, we can 
consider the i/-module ® W. Let s^'^ be its multiplicity in R^. Let 
s^'^(n) be the multiplicity of the trivial i/-representation in the iJ-module 
Rnd ^ ® Sym"(T^*). Then 



Theorem 4.1.2 Analogue of Theorem \4. 1.1 holds for s^ 



in . 



For the purposes of the flip, Theorem 14.1.11 suffices . 

Proof: We shall only prove Theorem 14.1.11 the proof of Theorem 14.1.21 be- 
ing similar. The proof is an extension of M. Brion's proof (cf. |Dhj ) of 
quasi-polynomiality of the stretching function associated with a Littlewood- 
Richardson coefficient of any semisimple Lie algebra. 

Clearly (a) follows from (b); cf. |Stl| . 
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(b) and (c): 

Let Cd be the cyclic group generated by the primitive root Q of unity of 
order d. It has a natural action on i?: x G Cd maps z € Rk to x^z. Let 
B = EP''^ = X^„>o Rnd C i? be the subring of C^-invariants. By Boutot 
[Bouj . i? is a normal C-algebra and spec(-B) has rational singularities. 

Assume that Hq is semisimple; extension to the reductive case being easy. 
Let vr* be the dominant weight of Hq such that V* = V^*. By Borel-Weil 
[FH], 

Ctt* = ©n>oK*7r = ©n>0^n7r*, 

is the homogeneous coordinate ring of the -ffo-orbit of the point Vt^* € -P( V^* ) 
corresponding to the highest weight vector. This i?o-orbit is isomorphic to 
Hq/Ptj*, where Pj^* Q Hq is the parabolic stabilizer of v^^* . Hence C^r* is 
normal and spec(C7r*) has rational signularities; cf. [Hal \MIi\ IRml ISmj . 
It follows that B (8) Ct^* is also normal, and spec(i? ® C-,^*) has rational 
singularities. Consider the action of C* on B ® Ct^* given by: 

x{b (g) c) = (x • 6) (g) {x~^ ■ c), 

where x £ C* maps b E B^ to the action on C-^* being similar. Consider 
the invariant ring 

S={B(S) C^,f* = (BnSn = ^n>0Rnd ® V*^. (4.2) 

By Boutot [B ou] , it is a normal, and spec(D) has rational singularities. 
Since Vnn is an //-module, the algebra S has an action of H. Let 

T = T{s^^) = 5^ = ®n>oTn (4.3) 

be its subring of //-invariants. By Boutot [Bouj . it is normal, and spec(r) 
has rational singularities-this is the crux of the proof. By Schur's lemma, the 
multiplicity of the trivial //-representation in Sn = Rnd ^ is precisely the 
multiplicity sj(n) of the //-module Vnn in Rnd- Hence, the Hilbert function 
of T, i.e., dim(r„), is precisely s'^{n), and the Hilbert series ^^>q dim(r„)t" 
is 3^(1). Quasipolynomiality of s^{n) follows by applying the following 
lemma: 

Lemma 4.1.3 (cf. JdBI) If T = ©J^qT^ is a graded C-algebra, such that 
spec{T) is normal and has rational simgularites, then dim(r„), the Hilbert 
function ofT, is a quasi-polynomial function of n. 
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(d) Since spec(T) has rational singularities, T is Cohen-Macaualey. Let 
ti, . . . ,t„ be its homogeneous sequence of parameters (h.s.o.p.), where u = 
k + 1 \s the Krull dimension of T. By the theory of Cohen-Macauley rings 
|St2j . it follows that its Hilbert series S'^{t) is of the form 

hQ + hit + --- + hkt^ 



(4.4) 



where (1) ho = 1, (2) di is the degree of tj, and (3) hiS are nonnegative 
integers. This proves (d). Q.E.D. 

Remark 4.1.4 A careful examination of the proof above shows that ratio- 
nality of S^it), and more strongly, asymptotic quasi-polynomiality of s'^{n) 
as n —5- oo, can be proved using just Hilbert 's result on finite generation of 
the algebra of invariants of a reductive- group action. Boutot's result is nec- 
essary to prove quasi-polynomiality for all n. This is crucial for saturated 
and positive integer programming (Chapter l^. 



4.1.1 The minimal positive form and modular index 

The form (j4.4|) of SJ{t) is not unique because it depends on the degrees di's 
of the paramters tj's. For future use, let us record the following consequences 
of the proof. Let T be the ring constructed in the proof above. 

Corollary 4.1.5 Suppose T has an h.s.o.p. t = {ti, . . . ,tu) with di = 
deg(ij). Then S2{T) has a positive rational form ^4-4] ) with di = deg(tj) 
therein. 

The proof above is lets us define a minimal positive form of the rational 
function S^it) associated with a structural constant s. For this, let us or- 
der h.s.o.p. 's of T lexicographically as per their degree sequences. Here the 
degree seqeunce of an h.s.o.p. t = {ti, ... ,tu) is defined to be (di, . . . , du), 
where di = deg(ti). The form (j4.4p is the same for any h.s.o.p. of lexi- 
cographically minimum degree sequence. We call it the minimal positive 
form of S^{t). The modular index of is defined to be maxjdj}, where 
{di, . . . ,du) is the degree sequence of a lexicographically minimal h.s.o.p. 
Since Problems 11.1. 11 II. 1.211.01 11.2.11 are special cases of Problem 11.1.41 
this defines minimal positive forms of the rational generating functions of the 
stretching quasi-polynomials (cf. Theorem 13. 4. ip associated with the struc- 
tural constants in these problems, and also the modular indices of these 
structural constants. 



68 



4.1.2 The rings associated with a structural constant 



The preceding proof also associates with the structural constant s a few 
rings which will be important later. Specifically, let S = S{s) and T = T(s) 
be the rings as in Theorem 14.1.11 (c) associated with the structural constant 
s = sj. Let R = R{s) be the homogeneous coordinate ring of X as in 
Theorem 14.1.11 We call R{s),S{s) and T{s) the rings associated with the 
structure constant s. 

When s = m^, as in the subgroup restriction problem (Problem ll.l.Sp . 
X = G/P as given in eq. (j3.10[ Then these rings are explicitly as follows: 

R{ml) = ®n>oVnxiG), 

S{ml) = ®n>oVnx{G)(^VnAHr, (4.5) 
T{ml) = ©„>o(Ka(G')0K.(F)*)^^. 

By specializing the subgroup restriction problem further to the Littlewood- 
Richardson problem (Problem 11.2. ip . we get the following rings associated 
by Brion (cf. [Dhj) with the Littlewood-Richardson coefficient c^^: 

Ric^fi) = ®n>Oyna{H)®Vnp{H), 

S^^ap) = ®n>0Vna{H)(2)Vnp{H)®Vnx{HY, (4.6) 
T{cip) = (Bn>o{Vna{H)<g>VnpiH)®Vnx{H)*f. 



4.2 Canonical models 



There are several rings other than r(c^ ^) whose Hilbert function coincides 
with the Littlewood-Richardson stretching quasi-polynomial c^^(n). For 
example, let P = P^^ be the SZ-polytope |BZ| whose Ehrhart quasi- 
polynomial coincides with c^^(n). We can associate with P a ring Tp 
as in Stanley |St3j whose Hilbert function coincides with ^ (n) . There 
are many other choices for P. For example, in type we can consider a 
hive polytope or a honeycomb polytope |KTlj instead of the BZ-polytope. 
The rings Tp's associated with different P's will, in general, be different, 
and there is nothing canonical about them. In contrast, the ring T(c^ ^) is 
special because: 

Proposition 4.2.1 (PHO) The rings R{c^^p), S{c^ p),T{c^ p) have quan- 
tizations Rq{c'^ jj), Sq{c^ /j)' /?) ^ndowed with canonical bases in the ter- 
minology of Lusztig lLu4f . Furthermore, the canonical bases of Rq{c^ ^), Sq{c'^ ^) 
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are compatible with the action of the Drinfeld-Jimbo quantum group associ- 
ated with H = GLn{C), and the canonical basis of Sq{c'^ ^j) is an extension 
of the canonical basis of Tq{c^ p) in a natural way. 

This follows from the work of Lusztig (cf. [Lu3| . Chapter 27 in |Lu4] ) and 
Kashiwara (cf. Theorem2 in |Kas3| ) . Specializations of these canonical 
bases at g = 1 will be called canonical bases of -R(c^ ^(c^ r(c^ ^). 
Lusztig |Lu4j has conjectured that the structural constants associated with 
the canonical bases in Proposition 14.2. 1] are polynomials in q with nonnega- 
tive integral coefficients as in the case of the canonical basis of the (negative 
part of the) Drinfeld-Jimbo enveloping algebra. We refer to Pr op osition 14 . 2 . f] 
as PHO in view of this (conjectural) positivity property. 

In view of this proposition, we call the rings R{c^ ^), S{c'^ ^) and r(c^ ^) 
the canonical rings associated with the Littlewood-Richardson coefficient 
c^^^, and X = Proj(iZ(c^^^)),y = Proj(5(c^^^)) and Z = Proj(r(c^^^)) the 
canonical models associated with c^^. 

4.2.1 From PHO to PH1,3 

Now we study the relevance of PHO above in the context of PH1,SH,PH2, 
and PH3 for Littlewood-Richardson coefficients (Section II. 2p . 

PHI 

As already remarked in Section 11.71 PHI for Littlewood-Richardson coeffi- 
cients is a formal consequence of the properties of Kashiwara's crystal oper- 
ators on the canonical bases in PHO (Proposition 14. 2.T]) : |Dhl IKas2l Il H ILu4] . 

Specifically, the canonical basis of the ring Rq{c^ ^) also yields a canon- 
ical basis for the tensor product Vg^a Vq,f3 of the irreducible Hg modules 
with highest weights a and /?. The Littlwood-Richardson rule for arbitrary 
types follows from the study of Kashiwara's crystal operators on this canon- 
ical basis for the tensor product; [Lu4j . This rule is equivalent to the one 
in [Li] based on combinatorial interpretation of the crystal operators in the 
path model therein. The article [Dhj derives a convex polyhedral formula 
for Littlewood-Richardson coefficients (of arbitrary type) using this com- 
binatorial interpretation. Though the complexity-theoretic issues are not 
addressed in |Dh] . it can be verified that the polyhedral formula therein is a 
convex ^P-formula. This yields PHI for Littlewood-Richardson coefficients 
of arbitrary types using PHO. 
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SH 



Now let us see the relevance of PHO in the context of SH for Littlewood- 
Richardson coefficients of arbitrary type. 

The polytope in |Dhj . mentioned above, for type A is equivalent to the 
hive polytope in |KTlj in the sense that the number integer points in both 
the polytopes is the same. Knutson and Tao prove SH for type A by show- 
ing that the hive polytope always has in integral vertex. To extend this 
proof to an arbitrary type, one has to convert the polytope in jPhj into a 
polytope that is guaranteed to contain an integral vertex if the index of the 
stretching quasipolynomial c^^(n) is one. The main difficulty here is that 
we do not have a nice mathematical interpretation for the index. Algorithm 
in Theorem 13.1.11 applied to the polytope in |Dhj computes this index in 
polynomial time. But it does not give a nice interpretation that can be used 
in a proof as above. 

This index is simply the largest integer dividing the degrees of all ele- 
ments in any basis of the canonical ring T'(c^ /3)~i^ particular, the canon- 
ical basis. This follows by applying Proposition 13.1.31 to the polytope in 
[Dhj . This leads us to ask: is there an interpretation for the index based on 
Lusztig's topological construction of the canonical basis in Proposition l4.2.lP 
If so, this may be used to extend the known polyhedral proof for SH in type 
A to arbitrary types. Alternatively, it may be possible to prove SH using 
topological properties of the canonical basis in the spirit of the topological 
(intersection-theoretic) proof [Blj of SH in type A. 

PH3 

Now let us see the relevance of PHO in the context of PH3 for Littlewood- 
Richardson coefficients. 

First, let us consider the minimal positive form (Section l4.1.ip associated 
with a Littlewood-Richardson coefficient ^ of type A. Let T = T{c'^i^) 
denote the ring that arises in this case; cf. eq. ()4.6p . Now we can ask: 

Question 4.2.2 Are all di's occuring in the minimal positive form (cf. 
^■4^ ) one in this special case? This is equivalent to asking if the ring 
T = T{c^ p) in this case is integral over Ti, the degree one component ofT. 

If so, this would provide an explanation for the conjecture of King at al 
|KTTj (cf. eq. (ll.3p ) in the theory of Cohen-Macauley rings: 
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Proposition 4.2.3 Assuming yes, the conjecture of King et al ]KTT^ (Hy- 
pothesis \1.2.6\) holds. 

Remark 4.2.4 In contrast, the ring Tp associated with the hive polytope 
(cf. beginning of Section \4-^ need not be integral over its degree one compo- 
nent, in view of the fact that the hive polytope can have nonintegral vertices 
iDMl]/ . 

Remark 4.2.5 T = T{c'^i^) need not be generated by its degree one compo- 
nent Ti. If this were always so, the h-vector (hd, ■ ■ ■ ,/io) in eg. U.3\) would 
be an M-vector (Macauley-vector) \St^ . But one can construct a,l3 and A 
for which this does not hold. 

Proof: (of the proposition) Since T is integral over Ti, it has an h.s.o.p., all of 
whose elements have degree 1. By Theorem l3.4.H the singularities of spec(r) 
are rational. Hence T is Cohen-Macaulay. Now the result immediately 
follows from the theory of Cohen-Macauley rings [St2j . Q.E.D. 

In view of this Proposition, the conjecture of King et al will follow if all 
canonical basis elements of T{c^ ^) can be shown to be integral over the basis 
elements of degree one. This requires a further study of the multiplicative 
structure of this canonical basis. Considerations for PH3 (Hvpothesis 11.2.8]) 
for Littlewood-Richardson coefficients of arbitrary type are similar. 

PH2 

Similarly, the positivity property (PH2) of the stretching quasipolynomial 
associated with Littlewood-Richardson coefficients may possibly follow from 
a deep study of the multiplicative structure of the canonical basis as per 
PHO (Proposition I4.2?T]) . just as positivity of the multiplicative structural 
coefficients of the canonical basis for the (negative part of the) Drinfeld- 
Jimbo enveloping algebra follows from a deep study of the multiplicative 
structure of this basis [Lu4j . 

4.2.2 On PHO in general 

The discussion above indicates that for Littlewood-Richardson coefficients 
PH1,SH,PH3, and plausibly PH2 as well are intimately related to PHO 
(Proposition I4.2.ip . This leads us to ask if the rings associated in Sec- 
tion 14.1.21 with other structural constants under consideration in this paper 
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have quantizations which satisfy appropriate forms of PHO. If so, this PHO 
may be used to derive PHI, SH, PH3, and PH2 (Hypotheses ICTlSXil) 
for these structural constants. Note that SH (a) follows from PH3 (see the 
remark after Hvpothesis 13.3.4]) : PH2 may also follow from PH3. Thus PHI 
and PH3 are the ones to focus on. 

To formalize this, let s be a structural constant which is either the Kro- 
necker coefficient as in Problem ll.l.ll or the plethysm constant as in Prob- 
lem [LL2l or the multiplicity in Problem ll.1.31 or the multiplicity sj, as 
in Problem II. 1.41 when X therein is a class variety. Let R{s), S{s),T(s) be 
the rings associated with s (Section I4.1.2p . Let X{s) = Proj(i?(s)), y(s) = 
Proj(5(s)) and Z{s) = Proj(i?(s)). We caU R = R{s),S = S{s),T = T{s) 
the canonical rings associated with s, and X{s),Y(s), Z(s) the canonical 
models associated with s, because we expect these rings and models to be 
special as in the case of the Littlewood- Richardson coefficients. 

Let H be as in Problem 11.1.31 or Problem 11.1.41 Assume that H is 
connected. Let Hq denote the Drifeld-Jimbo quantization of H. Now we 
ask: 



Question 4.2.6 (PHO??) Are there quatizations Rq, Sq of R,S, with Hq- 
action, and a quantization Tq of T with "canonical" bases (in some appro- 
priate sense) B{Rq), B{Sq), B{Tq), where B{Rq) and B{Sq) are compatible 
with the Hq-action and B{Sq) is an extension of B(Tq) ? Furthermore, do 
these canonical bases have appropriate positivity properties? 

In other words, are there quantizations of R, S and T for which PHO 
(Proposition \4-27l ) can be extended in a natural way? 



If so, this extended PHO may be used to prove PHI and SH for s just as 
in the case of Littlewood-Richardson coefficients (of type A) . 



4.3 Nonstandard quantum group for the Kronecker 
and the plethysm problems 

We now consider this question when s is the kronecker or the plethysm 
constant (cf. Problems II. 1.11 and ll.l.2p . PHO for Littlewood-Richardson 
coefficients (Proposition 14.2. ip depends critically on the theory of Drinfeld- 
Jimbo quantum groups. This is intimately related (in type ^4) |GrLj to the 
representation theory of Hecke algebras. To extend PHO in the context of the 
kronecker and the plethysm constants, one needs extensions of these theories 
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in the context of Problems II. l.Hfl.l.2[ In this section, we briefly review the 
results in |GCT4l IGCT81 IGCT7j in this direction and the theoretical and 
experimental evidence it provides in support of PHO-that is, affirmative 
answer to Question l4.2.6H n this context. 

So let us consider the generalized plethysm problem (Problem ll.l.2p . 
As expected, the representation theory of Drinfeld-Jimbo quantum groups 
and Hecke algebras does not work in the context of this general problem. 
Briefly, the problem is that if is a connected, reductive group and V its 
representation, then the homomorphism H ^ G = GL{V) does not quan- 
tize in the setting of Drinfeld-Jimbo quantum groups. That is, there is no 
quantum group homomorphism from Hq, the Drinfeld-Jimbo quantization 
of H, to Gq, the Drinfeld-Jimbo quantization of G. In |GCT4trGCT7] . a new 
nonstandard quantization G^ of G- called a nonstandard quantum group-is 
constructed so that there is a quantum group homomorphism Hq — > G^ . 
When H = G, Gq coincides with the Drinfeld-Jimbo quantum group. The 
article |GCT8j gives a conjectural scheme for constructing a nonstandard 
canonical basis for the matrix coordinate ring of G^ that is akin to the 
canonical basis for the matrix coordinate ring of the Drinfeld-Jimbo quan- 
tum group |Lu41 IKas3j . 

It is known that the Drinfeld-Jimbo quantum group Gq = GLq{V) and 
the Hecke algebra Hn{q) are dually paired: i.e., they have commuting ac- 
tions on V^"" from the left and the right that determine each other, where Vq 
denotes the standard quantization of V. Furthermore, the Kazhdan-Lusztig 
basis for Hn (q) is intimately related to the canonical basis for Gq |GrLj . Sim- 
ilarly, [GCT7j constructs a nonstandard generalization B^{q) of the Hecke 
algebra which is (conjecturally) dually paired to G^ . The article |GCT8j 
gives a conjectural scheme for constructing a nonstandard canonical basis of 
B^{q) akin to the Kazhdan-Lusztig basis of the Hecke algebra Hn{q). 

The nonstandard quantum group Gq and the nonstandard algebra Bl^{q) 
turn out to be fundamentally different from the standard Drinfeld-Jimbo 
quantum group Gq and the Hecke algebra Hn{q)- For example, the non- 
standard quantum group G^ is a nonflat deformation of G in general. This 
means the Poincare series of the matrix coordinate ring of G^ is different 
from the Poincare series of the matrix coordinate ring of G. Specifically, 
the terms of the first series can be smaller than the respective terms of the 
second series. Similarly, B^{q) is a nonflat deformation of the group algebra 
C[Sn] of the symmetric group Sn] i.e., its dimension can be bigger than that 
of C[5„]. 
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Nonflatness of intuitively means that it is "smaller" than G in gen- 
eral. Hence, it may seem that there is a loss of information when one goes 
from G to G^. Fortunately, there is none, as per the reciprocity conjecture 
in |GCT7j . This roughly says that the information which is lost in the tran- 
sition from G to simply gets transferee! to B^{q), which is bigger than 
Hn{q). In other words, there is no information loss overall. Hence analogues 
of the properties in the standard setting should also hold in the nonstandard 
setting, though in a far more complex way. 

That is what seems to happen to positivity. Specifically, experimental ev- 
idence suggests that the conjectural nonstandard canonical bases in |GCT8j 
have nonstandard positivity properties which are complex versions of the 
positivity properties in the standard setting. See |GCT71 IGCT8I IGGTlOj 
for a detailed story. 

4.4 The cone associated with the subgroup restric- 
tion problem 

In this section, we prove Theorem 13.4.21 by extending the proof of Brion 
and Knop (cf. [Elj) for the Littlewood-Richardson problem. The proof is in 
the spirit of the proof of quasipolynomiality in Section 14.11 

Let G be a connected, reductive group, H a connected, reductive sub- 
group, and p : H ^ G a homomorphism. Theorem 13.4.21 has the following 
equivalent formulation. Let S{H, G) be the set of pairs (/.i. A) such that 
V^{H) (S) VxiG) has a nonzero //-invariant. Then, 

Theorem 4.4.1 The set S{H,G) is a finitely generated semigroup with re- 
spect to addition. 

When G = H X H and the embedding H Q G is diagonal, this special- 
izes to the Brion-Knop result mentioned above. The proof follows by an 
extension the technique therein. 

Proof: Let B be a Borel subgroup of G, U the unipotent radical of B and 
T the maximal torus in B. Similarly, let B' be a Borel subgroup of H, U' 
the unipotent radical of B' and T' the maximal torus in B' . Without loss 
of generality, we can assume that B' C B, U' C U, T' C T. Let A = C[Gf 
be the algebra of regular functions on G that are invariant with respect to 
the right multiplication by U. It is known to be finitely generated [Mj. The 
groups G and T act on A via left and right multiplication, respectively. As 
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a G X T-module, 

A = (BxVxiG), (4.7) 

where the torus T acts on V\{G) via multiphcation by the highest weight 
A* of the dual module. Similarly, 

A' = C[Hf' = exV^{H), (4.8) 

where the torus T' acts on V^{H) via multiplication by the highest weight 
/i* of the dual module. 

Now A® A' is finitely generated since A and A' are. Let X = {A'S>A')^ 
be the ring of invariants of H acting diagonally on A(S)A'. The torus T xT' 
acts on X from the right. Since H is reductive, X is finitely generated |PVj . 
Hence, the semigroup of the weights of the right action of T x T' on X is 
finitely generated. We have 

X = {A® A'f = {{(BVxiG)) (eV;(F)))^ = e(VA(G) ® V^iH)f, 

and the weights of the algebra X are of the form (A*, /i*) such that Vx{G) (8> 
Vfj^{H) contains a nontrivial ff-invariant. Therefore these pairs form a 
finitely generated semigroup. Q.E.D. 

For the sake of simplicity, assume that G and H are semisimple in what 
follows. Let T^{H,G) denote the polyhedral convex cone in the weight 
space oi H X G generated by T{H, G), as defined in Theorem 13. 4. 2[ This is 
a generalization of the Littlewood-Richardson cone (Section I2.2.2p . 

The following generalization of Corollary 13.2.31 is a consequence of The- 
orem [3TLT] and its proof. 

Theorem 4.4.2 Assume that the positivity hypothesis PHI (Section \ 3.3\} 
holds for the subgroup restriction problem for the pair {H, G), where both H 
and G are classical. Given dominant weights ^, A of H and G, the poly tope 
PpL,\ IS in PHI has a specification of the form 

Ax <b (4.9) 

where A depends only on H and G, but not on ^ or A, and b depends 
homogeneously and linearly on /i, A. Let n be the total number of columns 
in A. 

Then, there exists a decomposition ofT^{H,G) into a set of polyhedral 
cones, which form a cell complex C{H, G), and, for each chamber C in this 
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complex, a set M[C) of 0{n) modular equations, each of the form 



1. Saturation hypothesis SH is equivalent to saying that: {fi, A) G T{H, G) 
iff{fi,X) G Tk{H,G) and (/u, A) satisfies the modular equations in the 
set M{Cij_^x) associated with the smallest cone C^^x G C{H, G) contain- 
ing (//, A). 

2. Given (/x, A), whether (/U, A) G Tr{H,G) can be determined in polyno- 
mial time. 

3. If so, whether (/x, A) satisfies the modular equations associated with 
the smallest cone in C{H, G) containing it can also he determined in 
polynomial time. 

Proof: Given a point p = (/i', A') in the weight space H x G, where /x' and 
A' are arbitrary rational points, let S{p) denote the constraints (half-spaces) 
in the sytem (14. Oh whose bounding hyperplanes contain the polytope Pfj,'.x'. 
We can decompose T^{H, G) into a conical, polyhedral cell complex, so that 
given a cone G in this complex, and a point p in its interior, the set S{p) 
does not depend on p. We shall denote this set by S{G). Thus the affine 
span of -P^^A) for any {fi, A) G C, is determined by the linear system 



where [A', 6'] consists of the rows of [A,b] in (j4.9p corresponding to the set 
S{G). By finding the Smith normal form of A' , we can associate with G a set 
of modular equations that the entries of b' must satisfy for this affine span to 
contain an integer point; see the proof of Theorem 13. l.li Since the entries of 
A' depend only on H and G, these equations depend only on G. If {fi, A) G 
T{H,G), then (/x, A) is integral, and hence these equations are satisfied. 
Conversely, if A) G T^{H,G) and these equations are satisfied, then the 
saturation property implies that (/i. A) G T{H,G), as seen by examining 
the proof of Theorem 13.1. 11 Furthermore, given (^u. A), the algorithm in the 
proof of Theorem 13.1.11 implicitly determines if (/x, A) G T-^{H,G) and if 
these modular equations are satisfied in polynomial time. Q.E.D. 




{mod d) 



such that 



= b' 
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4.5 Elementary proof of rationality 



In this section we give an elementary proof of rationality in Theorem 13.4.11 
(a), when H therein is connected-actually of a slightly stronger statement: 
namely, the stretching function m\{n) is asymptotically a quasipolynomial, 
as n — > oo; cf. Remark 14.1.41 But this proof cannot be extended to prove 
quasipolynomiality for all n. The proof here is motivated by the work of 
Rassart |Rsj , De Loera and McAllister on the stretching function associated 
with a Littlewood-Richardson coefficient. 

First, we recall some standard results that we will need. 
Vector partition functions 

Given an integral s x n matrix B and integral n-vector c, consider the vector 
paritition function 0_b(c), which is the number of integer solutions to the 
integer programming problem 



By Sturmfels |Stmj and Szenes-Vergne residue formula |SVj . (/'b(c) is a 
piecewise quasipolynomial function of c. That is, M" can be decomposed into 
polyhedral cones, called chambers, so that the restriction of </>_b(c) to each 
chamber ii is a multivariate quasipolynomial function of the coordinates of c. 
This implies that (t)B,c{n) is a quasipolynomial function of n. It also implies 
that the function 4>B,c,bin') is asymptotically a quasipolynomial function of 
n, as n ^ oo, because the points nc + b, as n ^ oo, lie in just one chamber. 

The Szenes- Verne residue formula |SV] for vector partition functions also 
implies that there is a constant d{B), depending only on B, such that the 
period of (pB,c{n'), for any c, divides d{B). 

Klimyk's formula 

Let H G and m\ be as in Theorem 13.4. II (a), with H connected. Let us 
assume that H is semisimple, the general case being similar. Let 7i and Q 
be the Lie algebras of H and G respectively. We recall Klimyk's formula for 
m^. Without loss of generality, we can assume that the Cartan subalgebra 



By = c, y>0. 



(4.10) 



For a fixed c, b, let 



(pB,c,b{n) = (j)Binc + b) 



(4.11) 
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C C is a subalgebra of the Cartan subalgebra V Q. So we have a 
restriction from V* to C* , and we assume that the half-spaces determining 
positive roots are compatible. We denote weights of 7i by symbols such as /i 
and of Q by symbols such as fi. To be consistent, we shall use the notation 
m| instead of in this proof. We write /2 | if the weight p. oi Q restricts 
to the weight fi oi 7i. We denote a typical element of the Weyl group of 
TC hy W, and a typical element of the Weyl group of ^ by T^. Given a 
dominant weight tt of Q and a weight fl of Q, let n^(A) denote the dimension 
of the weight space for p, in B-^ = V^{G). 

We assume that: 

(A): For any weight of 7i, the number of /2's such that fl I ^ is finite. 

For example, this is so in the plethysm problem (Problem ll.l.2p . We 
shall see later how this assumption can be removed. 

By Klimyk's formula (cf. page 428, |FHj ). 

"^! = E(-1)'^ E "a(^a), (4.12) 

where p is half the sum of positive roots of 7i. We allow p, in the inner sum 
to range over all weights p of Q such that p | tt — p — W{p) by defining 
nfi{V^) to be zero if p does not occur in V^. 

Proof of Theorem 13.4.11 (a) 

The goal is to express m|(n) as a linear combination of vector partition 
functions </'s,c,fe('^)'s, for suitable B,c,Vs, using Klimyk's formula for m^. 
After this, we can deduce asymptotic quasipolynomiality of m^(n) from 
asymptotic quasipolynomiality of (j)B,c,b{n)^s. 

By Kostant's multiplicity formula (cf. page 421 |FHj ) . 

My-x) = +p)-ifi+ P)), (4.13) 

w 

where P(A), for a weight A of Q, denotes the Kostant partition function; 
i.e., the number of ways to write A as a sum of positive roots of Q. It is 
important for the proof that Kostant's formula (j4.13|) holds even if p is not 
a weight that occurs in the representation Vy-in this case, np^iV^) = 0, and 
the right hand side of (|4.13p vanishes. 

By eq. (im]l and (imH . 
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K = ED-i)'^(-i)'^ E m(A+p-)-(A+p)). (4.14) 

W W flln-p-W{p) 

Let D denote the dominant Weyl chamber in the weight space of Q. Let 
C denote the Weyl chamber complex associated with the weight space of Q. 
The cells in this complex are closed polyhedral cones. Each cone is either 
the chamber W{D), for some Weyl group element W, or a closed face of 
W{D) of any dimension. 

Using Mobius inversion, the inner sum 

^ p{wcx+p)-m+p)) 

Pl-^-p-W{p) 

in eq. (|4.14p can be written linear combination 

J]a(C) Yl P{WC\ + P)-{P + P)), 

C p.€C:flln-p-W[p) 

where C ranges over chambers in the Weyl chamber complex C, a{C) is an 
appropriate constant for each C. 

Hence, 



WW C ji(zC:p.[TT-p-W{p) 

(4.15) 

Now think of vr and A as variables. But Ti and Q are fixed, and hence 
also the quantities such as p and p. 

Claim 4.5.1 For fixed Weyl group elements W,W and a fixed C, the sum 

P{W{X + p)-{-p + p)) (4.16) 

p.^C:pi-K-p-W{p) 

can he expressed as a vector partition function associated with an appropriate 
linear system 

By = c, y > 0, (4.17) 

where the matrix 
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depends only on C and the root systems of 7i and Q, but not on vr and X, 
and the coordinates of the vector 

depend on W, W, C, p, p, n, vr, and furthermore, their dependence on vr, A, p, p 
is linear. 

Here assumption (A) is crucial. Without it, the sum (14.16P can diverge. Of 
course, without assumption (A), we can still make the sum finite, by requir- 
ing that fL lie within the convex hull generated by the points {W^(A)}, 
where W ranges over all Weyl group elements. This means we have to add 
constraints to the system (j4.17p corresponding to the facets of H^. But 
the entries of the resulting B would depend on A, and the theory of vector 
partition functions will no longer apply. 

Proof of the claim: Let /ij's denote the integer coordinates of fi in the basis 
of fundamental weights. We denote the integer vector {fii, fi2i • • •) by fl 
again. The Kostant partition function -P(i') is a vector partition function 
associated with an integer programming problem: 

Bpv = I', V > 0, 

where the columns of Bp correspond to positive roots of Q. The sum in 
()4.16p is equal to the number of integral pairs v) such that 

1. fteC, 

2. filTr-p-W{p), 

3. Bpv = W{X + p) - {p + p), V >0. 

The first two condititions here can be expressed in terms of linear con- 
straints (equalities and inequalities) on the coordinates pi's. Thus the three 
conditions together can be expressed in terms of linear constraints on {p, v). 
By the finiteness assumption (A), the polytope determined by these con- 
straints is a bounded polytope. The number of integer points in such a 
polytope can be expressed as a vector partition function (cf. |BBCV] ). This 
proves the claim. 

Let us denote the vector partition associated with the integer program- 
ming problem (14.170 in the claim by (^(c(A, vr, p, p)). Then 

< = H E aiC)<Pw,w,cica^ vr, p, p)). (4.18) 

WW c 
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Hence, 

(n) =m^l = Y^ ^ a(C7),^^^^^^^(c(nA, nvr, p, p)). 

VI/ c 

(4.19) 

It follows from Claim 14.5.11 and the standard results on vector partition 
functions mentioned in the begining of this section that 

9w,w,ci^) = 'Aiy,Ty,c(c('^A,n7r,/9,p)), 

is asymptitically a quasipolynomial function of n. Hence, 7Ti|(n) is also 
asymptotically a quasipolynomial function of n. This implies (cf. [Stlj ) 
that 

M^,it) = Y,rhlin)r (4.20) 

n>0 

is rational function of t. 

This proves Theorem 13.4.11 (a) under the finiteness assumption (A). 

It remains to remove the assumption (A). Let Q' ^ 7i he the smallest 
Levi subalgebra of Q containing 7i. Then 

K = EK'<" (4-21) 

tt' 

where tt' ranges over dominant weights of Q' , m^' denotes the multiplicity of 
V,^/{Q') in V)^{G), and jtt,^, the multiplicity of ^^('T^) in K-'(^')- Furthermore, 

1. the finiteness asssumption (A) is now satisfied for the pair {Q' , TL): i.e., 
for any weight /i of Ti, the number of weights /Li"s of Q' such that n' i n 
is finite. 

2. There is a polyhedral expression for this follows from [Li] IDhj . 

By the first condition and the argument above, we get an expression for 
m^, akin to (I4.18p . Substituting this expression and the polyhedral expres- 
sion for in ()4.2ip . leads to a formula for m'^{n) as a linear combination 
of 4>B,c,b{i^y^ for appropriate i?,c, 6's. After this, we proceed as before. 

This proves Theorem [37i7T] (a). Q.E.D. 

We also note down the following consequence of the proof. 

Proposition 4.5.2 There is a constant D depending only Q and Tt, such 
that for any A,7r, orders of the poles of M^{t) (cf. ^.20^ , as roots of unity, 
divide D. 
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A bound on D provided by the proof below is very weak: D = 0(2'-^(^^^^(^))). 

Proof: It suffices to to bound the period of the quasipolynomial mj^{n). For 
this, it suffices to let n oo. For a fixed W, W, C, the chamber containing 
c(nA, n-K, p, p)) is completely determined by A and vr as n ^ oo. Under these 
conditions, the degree of (piY^y (^(c(nA, nvr, p, p)) is equal to the dimension of 
the polytope associated with this vector partition function. This dimension 
is clearly 0(rank(^)^). 

By Szenes-Vergne residue formula |SVj , there is a constant D depending 
on only Q, TC, W, W, C, such that the period of the quasipolynomial h{n) = 
(j)yy^Q{c{nX,mr,0,0)) divides D for every A,7r; here we are putting p and 
p equal to zero, since we are interested in what happens as n — > oo. Q.E.D. 
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Chapter 5 



Parallel and PSPACE 
algorithms 



In this chapter we give PSPACE algorithms (cf. Theorem I3.4.3P for com- 
puting the various structural constants under consideration . We shall only 
prove Theorem 13.4.31 when H is therein is either a complex, semisimple 
group, or a symmetric group, or a general linear group over a finite field, 
the extension to the general case being routine. 

We recall two standard results in parallel complexity theory |KR| . which 
will be used repeatedly. 

Let NC{t{N),p{N) denote the class of problems that can be solved 
in 0{t{N)) parallel time using 0{p{N)) processors, where N denotes the 
bitlength of the input. Let 

NC = U,iVC(W(iV),poly(iV)). 

This is the class of problems having efficient parallel algorithms. 

Proposition 5.0.3 lCs\ \KR^ Let A he an n x n-matrix with entries in a 
ring R of characteristic zero. Then the determinant of A, and A~^ , if A 
is nonsingular, can he computed in O(log^n) parallel steps using poly{n) 
processors; here each operation in the ring is considered one step. Hence, if 
R = Q, the problems of computing the determinant, the inverse and solving 
linear systems belong to NC. 

Proposition 5.0.4 The class iVC(t(iV), 2*(^)) C SPACE{0{t{N))). In 
particular, NC{poly{N),2^^P°^y^^^'^) C PSPACE. 
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5.1 Complex semisimple Lie group 



In this section we prove a special case of Theorem 13.4.31 for the general- 
ized plethym problem (Problem I1.1.2P . Accordingly, let H he a, complex, 
semisimple, simply connected Lie group, G = GL{V), where V = V^{H) is 
an irreducible representation of H with dominant weight fi, p : H ^ G the 
homomorphism corresponding to the representation, and the multiplic- 
ity of VTr{H) in Vx{G), considered as an //-module via p; cf. Problem ll.l.3[ 
Then: 

Theorem 5.1.1 The multiplicity can be computed in poly{{X) , {p) , (tt) , dim 
space. 

Here it is assumed that the partition A = Ai > A2 > • • • A,. > is rep- 
resented in a compact form by specifying only its nonzero parts Ai, . . . , A^. 
This is important since dim(G) can be exponential in dim{H) and {p). A 
compact representation allows (A) to be small, say poly(dim(/r), (p)), in this 
case. 

We begin with a simpler special case. 

Proposition 5.1.2 If dimiV) = poly{dim{H)) , then m\ can he computed 
in PSPACE; i.e., in poly{{X), (p), (vr), dim(iJ)) space. 

This implies that the Kronecker coefficient (Problem I l.l.ip can be computed 
in PSPACE. 

Proof: Let us use the notation A instead of A to be consistent with the 
notation used in Klimyk's formula (j4.12p . By the latter, can be computed 
in PSPACE if nfi{V^) in that formula can be computed in PSPACE for every 
p and A. In type A, this is just the number of Gelfand-Tsetlin tableau with 
the shape A and weight p. If dim(y) = poly(dim(i/)), the size of such 
a tableau is 0(dim(y)^) = poly(dim(//)). So we can count the number 
of such tableu in PSPACE as follows: Begin with a zero count, and cycle 
through all tableaux of shape A in polynomial space one by one, increasing 
the count by one everytime the tableau satisfies all constraints for Gelfand- 
Tsetlin tableau and has weight p. In general, the role of Gelfand-Tsetlin 
tableaux is played by Lakshmibai-Seshadri (LS) paths [Lil IDhj . Q.E.D. 

The argument above does not work if dim(y) is not poly(dim(ff)), as 
in the plethym problem (Problem ll.l.2p . where dim(y) = dim(V^) can 
be exponential in n = dim[H) and the bitlength of p. In this case, the 
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algorithm cannot even afford to write down a tableau since its size need not 
be polynomial. 

Next we turn to Theorem 15.1.11 For the sake of simplicity, we shall 
prove it only for H = S'L„(C), or rather GL„(C)~i.e., the usual plethysm 
problem. This illustrates all the basic ideas. The general case is similar. We 
shall prove a slightly stronger result in this case: 

Theorem 5.1.3 The plethysm constant ^ can he can he computed in 
poly{{\), in), (vr)) space. 

Here the dependence on n = dim(i7) is not there. This makes a difference 
if the heights of fi and vr are less than n = dim(i?)~remember that we are 
using a compact representation of a partition in which only nonzero parts 
are specified. This is really not a big issue. Because ^ depends only on 
the partitions A, fi, vr and not n. Hence, without loss of generality, we can 
assume that n is the maximum of the heights of fj, and vr. It is possible to 
strengthen Theorem 15.1.11 similarly. 

To prove Theorem 15.1.31 we shall give an efficient parallel algorithm to 
compute ^ that works in poly((A), (//), (vr)) parallel time using 0(2?°^^^^'^^'^^'^'^'^^)) 
processors. This will show that the problem of computing a J ^ is in the com- 
plexity class AfC(poly((A), (//), (vr)), 2Poly(<-^>'<^>'<''»), which is contained in 
PSPACE by Proposition 15.0.41 The basic idea is to parallelize the classical 
character-based algorithm for computing ^ by using efficient parallel algo- 
rithm for inverting a matrix and solving a linear system (Proposition 15.0.^ . 

We begin by recalling the standard facts concerning the characters of 
the general linear group. Given a representation W of GLm{C), let p : 
GLm(C) — > GL{W) be the representation map. Let Xpi^ii ■ ■ ■ i^m ) de- 
note the formal character of this representation W . This is the trace of 
/9(diag(xi, . . . , Xm)), where diag(xi, . . . , denotes the generic diagonal ma- 
trix with variable entries xi, . . . , Xm on its diagonal. If W is an irreducible 
representation V\{GLm{'C))., then Xpi^i-, ■ ■ ■ -iXm) is the Schur polynomial 
S\{xi, . . . , Xm)- By the Weyl character formula, 



where |o* | denotes the determinant of an m x m-matrix a. The Schur polyno- 
mials form a basis of the ring of syninietric polynomicils in xi, • • • , x^a- 

The 
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simplest basis of this ring consists of the complete symmetric polynomials 
M^(xi, . . . , Xm) defined by 

Ma(xi, . . .,Xm) = y^t"', 

7 

where 7 ranges over all permutations of /? and t"^ = x]^ . Schur polyno- 
mials are related to Mg by: 

Sx = Y.klMp, (5.2) 

/3 

where is the Kostka number. This is the number of semistandard tableau 
of shape A and weight f3. 

If the representation W is reducible, its decomposition into irreducibles 
is given by: 

VF = J^m(7r)14(GL„(C)), (5.3) 

TT 

where m(7r)'s are the coefficients of the formal character xpi^i: ■ ■ ■ i^m) in 
the Schur basis: 

= ^m(7r)S'^. 

Proof of Theorem 15.1.31 

Let X,fi,TT be as in Theorem [5X3l Let H = GL„(C), V = Vf,{H), G = 
GL{V). Let s\{xi, . . . ,Xm) be the formal character of the representation 
V\{G) of G. Here m = dim(V^) can be exponential in n and (/x). The basis 
of V^{H) is indexed by semistandard tableau of shape with entries in [1, n]. 
Let us order these tableau, say lexicographically, and let Tj, 1 < i < m, 
denote the i-ih. tableau in this order. With each tableau T, we associate a 
monomial 

n 
i=l 

where Wi{T) denotes the number of i's in T. Given a polynomial f{xi, . . . , Xm), 
let us define = /^(ti, . . . ,tn) to be the polynomial obtained by substi- 
tuting Xi = t{Ti) in f{xi,...,Xm)- Then the formal character of Vx{G), 
considered as an //-representation of via the homomorphism H ^ G = 
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GL{Vij,{H)), is the symmetric polynomial Sx^^{ti, . . . ,tn) = {Sx)^. The 
plethysm constant a'^ ^ is defined by: 

Sx,^{ti,...,tn) =Y,<,f^SAtl,...,tn). (5.4) 

7r 

An efficient parallel algorithm to compute aj^ is as follows. Here by an 
efficient parallel algorithm, we mean an algorithm that works in poly((A), (vr)) 
time using 2?°^^'^^'^^'^^^'^'^^) processors. We will repeatedly use Proposi- 
tion [5131 



Algorithm 

(1) Compute Sx,^{ti, . . . ,tn)- By the Weyl character formula (j5.1 

Ax,ti{ti, ■ ■ ■ ,tn) 



Sx,iJ.{ti, ■ ■ ■ ,tn) 



Bx,ti{tl, ■ ■ ■ ,tn) 



where Ax{xi, . . . , Xm) and Bx{xi, . . . , Xm) denote the numerator and denom- 
inator in ([M]), and Ax^^j, = (^a)aj, and Bx,^, = {Bx)^- Let R = C[ti, . . . ,tn\- 
Then 

AxAti,---,tn) = \t{Tj)^^^^-% 

This is the determinant of an m x m matrix with entries in R, where m = 
dim(y) can be exponential in n and (/i). It can be evaluated in O(log^m) 
parallel ring operations using poly(m) processors. Each ring element that 
arises in the course of this algorithm is a polynomial in ti,. . . ,tn of total 
degree 0{\X\m), where |A| denotes the size of A. The total number of its 
coefficients is r = 0((|A|m)"). Hence each ring operation can be carried 
out efficiently in 0(log^(r)) parallel time using poly(r) processors. Since 
logm = poly(?i, (/.f)) and logr = poly(n, (A), (/-*)), it follows that Ax^^ can 
be evaluated in poly(n, (fi), (A)) parallel time using 2?°^^^"'^'^''^^) processors. 
The determinant Bx,^ can also be computed efficiently in parallel in a similar 
fashion. To compute Sx,f_i, we have to divide Ax^^ by Bx^fj,- This can be done 
by solving an r x r linear system, which, again, can be done efficiently in 
parallel. This computation yields representation of 5a, ^ in the monomial 
basis {Ma} of the ring of symmetric polynomials in ti, . . . , tn- 

(2) To get the coefficients aj^, we have to get the representation of Sx,fi{t) 
in the Schur basis. This change of basis requires inversion of the matrix 
in the linear system (|5.2p . The entries of the matrix K occuring in this 
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linear system are Kostka numbers. Each Kostka number can be computed 
efficiently in parallel. Hence, all entries of this matrix can be computed 
efficiently in parallel. After this, the matrix can be inverted efficiently in 
parallel, and the coefficients a'^ ^'s of S'a,/^ in the Schur basis can be computed 
efficiently in parallel. Finally, we use Proposition 15. U.4| to conclude that ^ 
can be computed in PSPACE. Q.E.D. 



5.2 Symmetric group 

Next we prove Theorem 13.4.31 when H = Sm.. Let X = V^(5m) be an 
irreducible representation (the Specht module) of Sm corresponding to a 
partition fi of size m. Let p : H G = GL{X) be the corresponding 
homomorphism. 

Theorem 5.2.1 Given partitions A, /U,7r, where fi and tt have size m, the 
multiplicity ^ of the Specht module ^-(Sm) in V\{G) can he computed in 
poly{m, (A)) space. 

Remark 5.2.2 The bitlengths {p) and (vr) are not mentioned in the com- 
plexity bound because they are bounded by m. 

For this, we need three lemmas. 

Lemma 5.2.3 The character of a symmetric group can be computed in 
PSPACE. Specifically, given a partition tt of size m, and a sequence 
i = (ii,i2,...) of nonnegative integers such that '^jij = rn, the value of 
the character x-k of Sm on the conjugacy class Ci of permutations indexed 
by i can he computed in poly{m) parallel time using 2P^^y^'"^^ processors. 
Hence it can be computed in poly{m) space (cf. Proposition \5.0.4\ )- 

Here the conjugacy class C, consists of those permutations that have ii 
1-cycles, Z2 2-cycles, and so on. 

Proof: Let k be the height of the partition vr. Let x = (xi, . . . ,Xk) be the 
tuple of variables Xi's. Given a formal series f{x) and a tuple {li, . . . ,1^) of 
nonnegative integers, let ;^.) denote the coefficient of x''^ ■ ■ ■ x^ in 

/. 

By the Probenius character formula |FH] . 

Xx{Ci) = \f{x)\i,_i,). (5.5) 
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where 

h = TTl + k - l,l2 = + k - 2, . . . ,lk = T^k, 

and 

m 

/(x) = A(x)^^J(^r^ 

with 

= x-{-\ l-x^. 

Since deg(/) = poly(m) and k < m, the total number of coefficients of 
f{x) is 2?°^^^™"^. Hence, we can evaluate f{x) in PSPACE by setting up 
appropriate recurrence relations. 

Alternatively, we can easily evaluate f{x) in poly(m) parallel time using 
2Poly("^) processors, and then extract its required coefficient. After this, the 
result follows from Proposition 15.0.41 Q.E.D. 

Lemma 5.2.4 Suppose (f) is a character of Sm whose value on any conju- 
gacy class Ci can he computed in 0{s) space, for some parameter s. Then, 
the multiplicity of the representation T4-(5'm) in the representation 1/^(5"^) 
corresponding (j) can he computed in O{poly{m) + s) space. 

Proof: The multiplicity is given by the inner product 

(<^,X^> = ^ E <^("^)^-(^)- (5.7) 

By assumption, <j){cr) can be computed in 0{s) space, and by Lemma 15.2.31 
X7r(c) can be computed in poly(m) space. Hence, the result follows from 
the preceding formula. Q.E.D. 

Given an irreducible representation X = V^(S'm) and an irreducible rep- 
resentation W = Vx{G) of G = GL{X)), let denote the representation 
map 5m G, p\ the representation map G — > GL(VF), and 

p:S^^G^ GL{W) 

their composition. This is a representation of Sm- Let xp be the character 
of p. 

Lemma 5.2.5 For any a S Sm, Xpi^) can he computed in poly{m, (A)) in 
poly{m, (A)) space. 
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The bitlength (//) is not mentioned in the complexity bound because it 
is bounded by m. 

Proof: Let r = dim(X). The formal character of the representation V\{G) 
of G = GL{X) is the Schur polynomial -^^(xi, . . . , x^), r = dim{X). Hence, 

Xp(o-) = Sx{a) 

where a = (ai, . . . , a^) is the tuple of eigenvalues oi p^{a). We shall compute 
the right hand side fast in parallel-i.e., in poly(m, (A)) parallel time using 
2Poly(™'(-^)) processors-and then use Proposition l5.0.4l to conclude the proof. 
This is done as follows. 

(1) Let x^l denote the character of the representation p^. Let Pi{a) = a\ + 
■ • • + al denote the i-th power sum of the eigenvalues. For any i, 

We can compute a\ for i < |A|, where |A| denotes the size of A, in poly(log i, m) = 
poly(m, (A)) time using repeated squaring. After this Xfi{(^^) can be com- 
puted fast in parallel in poly(m) time using Lemma 15.2.31 Thus each pi{a) 
can be computed in poly(m, (A)) time in parallel using 2?°^^'-'"'^'^^^ proces- 
sors. We calculate Pi{a) in parallel for alH < |A|, and all p^{a) = WjP-yjia) 
in parallel for all partitions 7 of size at most m. 

(2) After this, we calculate the complete symmetric function hi{a), for 
each i < |A|, fast in parallel, by using the relation [Mcj : 

hi = ^ ] p^, 

h\=i 

where z-y = Y\i>i i"^^mi\, and nii = mj(7) denotes the number of parts of 7 
equal to i. Thus we can calculate hy{a) = Y\j h^.{a), for all partitions 7 of 
size m, fast in parallel. 

(3) To compute Sx{a), we recall that the transition matrix between 
the Schur basis {5a} and the complete symmetric basis {h^} of the ring 
of symmetric functions is K* , the transpose inverse of the Kostka matrix 
K = [Kx^^], where Kx,-y denote the Kostka number; cf. |Mcj . As we noted in 
the proof of Theorem l5.1.3l each Kostka number can be computed in fast in 
parallel. Hence, K can be computed fast in parallel. After this, its inverse 

can be computed fast in parallel by Proposition l5.0.3] -this is the crux 
of the proof-and finally K* as well. Thus Sx{o:) can be computed fast in 
parallel, since each /i^(a) can be computed fast in parallel. Q.E.D. 

Theorem EXH follows from Lemma EZ3E23] and EZS Q.E.D. 
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5.3 General linear group over a finite field 



In this section we prove Theorem 13.4.31 when H therein is the general hn- 
ear group GLn{Fpk) over a finite field Fpk. Irreducible representations of 
H = GLn{Fpk) have been classified by Green [Mcj . They are labelled by 
certain partition- valued functions. See [Mcj for a precise description of these 
labelling functions. It is clear from the description therein that each labelling 
function has a compact representation of bitlength 0{n + k + {p)), where 
(p) = log2 p; we specify a function by giving its partition values at the places 
where it is nonzero. Let fi denote any such label. Let X = V^{H) be the 
corresponding irreducible representation of and p : H ^ G = GL{X) 
the corresponding homomorphism. 

Theorem 5.3.1 Given a partition A and labelling functions ^ and vr as 
above, the multiplicity m\ ^ of the irreducible representation Vt^{H) in V\{G) 
can be computed in poly{n,k, (p), (A)) space. 

The proof is similar to that of Theorem 15.2.11 for the symmetric group 
with the following result playing the role of Lemma I5.2.3t 

Lemma 5.3.2 Given a labels of an irreducible character x-y of H = GLn{Fpk) 
and a label 5 of a conjugacy class in H , the value x-y (5) can be computed 
in poly{n, k, (p)) parallel time using 2^^^^^"''^'^*'^) processors, and hence by 
Proposition \5.0.4\ in poly(n,k, (p)) space. 

The label 5 of a conjugacy class in H is also a partition valued function 
[Mcj . which admits a compact representation of bitlength poly(n, k, {p)). 

Proof: We shall parallelize Green's algorithm [Mcj for computing the charac- 
ter values, and then conclude by Proposition l5.0.3l Green shows that X'yi^Y^ 
are entries of a transition matrix between a two polynomial bases: the first 
constructed using Hall-Littlewood polynomials, and the second using Schur 
polynomials. We have construct this transition matrix fast in parallel. We 
shall only indicate here how the transition matrix between the basis of Hall- 
Littlewood polynomials and the Schur basis for the ring symmetric functions 
over Z[t] can be constructed fast in parallel. This idea can then be easily 
extended to complete the proof. 

First, we recall the definition of the Hall-Littlewood polynomial Pn{x; t) = 
P^(xi, . . . , Xfc; i) [Mcj . This is a symmetric polynomial in Xj's with co- 
efficients in It interpolates between the Schur function STr{x) and 
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the monomial symmetric function ■m-,j[x) because Ptj{x;Q) = Stj{x) and 
P-k{x] 1) = m-,^{x). The formal definition is as follows: 

For a given partition vr, let VTj[t) = Wi>QVmi{t)., where mj is the number 
of parts of vr equal to i, and 

™ 1 - 

Vm{t) = n 
i=l 



Then 



where 



A^{x, t) = T.a&Sk sgn(fT)fT(2;ii • • • ni<i ^» - 
B^{x,t) = v.,r(t)l\i^j{xi - Xj). 

Here sgn((7) denotes the sign of a. 

Let t(;7r,a(i)'s be the coeffcients of P.^{x,t) in the Schur basis: 



(5.9) 



P.^{x;t) ='^WTr,a{t)Sa{x). (5.10) 
a 

We want to calculate the matrix W = \ 

"f^TTjo] fsst in parallel. Using 
formula (j5.9p . we calculate A.,^{x;t) fast in parallel; i.e., we calculate the 
coefficients of AT^{x;t) in the basis of monomials in x and t. We calculate 
i?7r(x;t) similarly. After this the division in (j5.8p can be carried out by 
solving a an appropriate linear system. This can be done fast in parallel 
by Proposition 15.0.31 Since, P-,^{x]t) is symmetric in Xj's, this yields its 
coefficients in the monomial symmetric basis {ma{x)} with the coefficients 
being in The transition matrix |Mc] from the monomial symmetric 

basis to the Schur basis is given by the inverse of the Kostka matrix. This 
inverse can be computed fast in parallel by Proposition 15.0.31 After this, 
the coefficients Wi^^aS of PT^{x]t) in the Schur basis can be computed fast in 
parallel. 

Furthermore, the inverse oi W = \W-w,a] can also be computed fast in 
parallel by Proposition 15.0.31 Q.E.D. 

5.3.1 Tensor product problem 

Analogue of the Kronecker problem (Problem I l.l.ip for H = GLn{Fpk) is: 
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Problem 5.3.3 Given partition valued functions A, fi, n, decide if the mul- 
tiplicity h\ ^ ofVT^{H) in the tensor product V\{H) (g) Vfj_{H) is nonzero. 

In this context: 

Theorem 5.3.4 The multiplicity ^ can be computed in PSPACE; i.e., 
in poly{n, k, {p)) space. 

Proof: This fohows from Lemma 15.3.21 and analogues of Lemmas 15.2.41 and 
[523] in this setting. Q.E.D. 

A possible canditate for a stretching function assoociated with 5^ ^ is: 

where nX denotes the stretched partition- valed function obtained by stretch- 
ing each partition value of A by a factor of n. In other words b\ ^{n) is 
the multiplicity of Vn-K{H{n)) in Vn\{H{n)) Vn^{H{n)), where H{n) = 
GLnm{Fpk) is the stretched group. Is it a quasi-polynomial? If so, we can 
also ask for a good bound on its saturation and positivity indices. 

5.4 Finite simple groups of Lie type 

The work of Deligne-Lusztig |DLj and Lusztig [Lu5j yield an algorithm for 
computing the character values for finite simple groups of Lie type. 

Question 5.4.1 Can this algorithm be parallelized? 

If so, Lemma I5.3.2| and hence Theorem 15.3. H can be extended to finite 
simple groups of Lie type. 
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Chapter 6 

Experimental evidence for 
positivity 

In this chapter we give experimental evidence for positivity (PH2,3). 

6.1 Littlewood- Richardson problem 

Experimental evidence for PH2 in the context of the Littlewood-Richardson 
problem (Problem ll.2.ip has been given in |DM2j , and for PH3 in type A 
in [KTTj ■ We give experimental evidence for PH3 in types B,C,D here. 
Let C^p{t) be as in eq. (|1.2|) . Its reduced positive form for various values 
of a, /?, A is shown in Figure 16.11 for type B, in Figure 16.21 for type C, and 
Figure 16.31 for type D. The rank of the Lie algebra is three in all cases. 
In these types, the period of the stretching quasipolynomial c^^(n) is at 
most two. Accordingly, the period of every pole of p{t) is at most two. 
The tables were computed from the tables in [DM2] for the stretching quasi- 
polynomial c^^(n) in these cases. 

6.2 Kronecker problem, n = 2 

Let k\ ^ be the Kronecker coefficient in Problem ll.l.li Let k\ ^{n) = k^xn^i 
be the associated stretching quasi-polynomial, and 

n>0 
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the associated rational function. An explicit formula (with alternating signs) 
for the Kronecker coefficient, when n = 2, has given by Remmel and White- 
head |RWj and Rosas [Roj . and a positive formula in |GCT9j . This case 
turns out to be nontrivial. For example, the number of chambers (domains) 
of quasi-polynomiality in this case turns out to be more than a million. Their 
explicit description can be found out using the formula for the Kronecker 
coefficient in jRW] . 

We implemented Rosas' formula to check PH2 for the quasipolynomial 
^{n) for a few thousand values of fi, v and A with the help of a computer. 
A large number of samples was chosen to ensure that a significant fraction 
of the chambers were sampled. The quasi-polynomial (n) and a positive 
form of the rational function C'^^{t) are shown Figures 16.41 and 16.51 for few 
sample values of A = (Ai,A2), /i = (/xi,/Z2), and vr = (vri, 7r2, vra, 7r4). It 
may be noted that fcj^(n) need not be a polynomial; this answers Kirillov's 
question [Kij in the negative. But its period is at most two for n = 2. This 
follows from the formula in |RWj . For the A,/i and vr that we sampled, 
positivity index of A;J^(n) is always zero. But it turns out [BORj that 
there are some A, ^ and vr for which the saturation and positivity indices of 
A:J^(n) are nonzero (one), but very small and thus consistent with SH and 
PH2 (Hvpothesi j 1.6.6]) in this paper; in the earlier version of this paper, SH 
and PH2 stipulated that the saturation and positivity indices are always 
zero. These (A, /i, vr) escaped our random sampling, because their density is 
extremely small |BOR] . 

6.3 G/P and Schubert varieties 

Let V = V\{G) be an irreducible representation of G = SLk{C) correspond- 
ing to a partition A. Let vx be the point in P{V) corresponding to the 
highest weight vector, and X = Gv\ = G/P\ its closed orbit. Let hk^x{n) 
be the Hilbert function of the homogeneous coordinate ring R of X. It is 
a quasipolynomial since spec(i?) has rational singularities. In fact, it is a 
polynomial, since t = 1 is the only pole of the Hilbert series 

n>0 

Figure [6^ gives experimental evidence for strict positivity (PH2) of h^^\{'n) 
(as discussed in Section [333]) for a few sample values of k and A. Figure [6771 
gives experimental evidence for strict positivity of the Hilbert polynomial 



96 



of the Schubert subvarieties of the Grassmanian; there Gn.k denotes the 
Grassmannian of A;-planes in V = C", and 0,a, a = (a(l), . . . , a(d)) its 
Schubert subvariety consisting of the /c-subspaces W such that dim(VF n 
) > i for ah i, where V — D ■ ■ -Vi D is a complete flag of 
subspaces in V. The Hilbert polynomials were computed using the explicit 
polyhedral interpretation for them deduced from the theory of algebras with 
straightening laws (Hodge algebras) |DEP2] . 

6.4 The ring of symmetric functions 

Let y = C^ G = GL{V), H = Sk, with the natural embedding H 

G. Let us consider the spacial case of the subgroup restriction problem 
(Problem ll.l.3p . with V\{G) = V, and VjriH) the trivial representation of 

H. Then s = mj, the multiplicity of the trivial representation in V, is 
one. Though the decision problem (Problem ll.l.Sp is trivial in this case, the 
canonical model associated with s is nontrivial. 

The canonical rings R = R{s) and S = S{s) associated with s in this 
case coincide with C[V] = C[xi, . . . ,Xk]- The ring T = T{s) = = 
C[xi, . . . ,Xfi.]^'= is the subring of symmetric functions. Its Hilbert function 
h{n) is a quasipolynomial. PHI and PH3 for Z = Proj(r), as per Defini- 
tion 13.5.21 follow easily, the latter from the well known rational generating 
function for the partition function |Stl| . But PH2 turns out to be nontriv- 
ial. Figures 16.8116. 13l give experimental evidence for strict positivity of h{n) 
(PH2). In these figures, the i-th row of the table for a given k shows hi{n), 
where hi{n), 1 < i < I, are such that h{n) = hi{n), when n = i modulo the 
period / of h{n). 
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Figure 6.1: C^^p{t) for S3 
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Figure 6.2: C^_^(t) for C3 
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Figure 6.3: C^^p{t) for D3 
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Figure 6.4: The quasipolynomial fcj and the rational function K'^ it) for the Kronecker problem, n = 
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Figure 6.5: Continuation of Figure [631 
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Figure 6.6: Hilbert polynomial for G/Px, G = SLk{C). There is a slight rounding error caused by interpolation- 
e.g., the constant term of each polynomial should be one. 
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Figure 6.7: Hilbert polynomial of the Schubert subvariety 0^, a = (a(l), . . . , a{k)), of the Grassmannian Gn,k- 
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Figure 6.8: The Hilbert quasipolynomial of = C[xi, . . . , x^]'^''; k = 2,3, 4. 
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1 „4 I 11728124029611 „3 , 473400839737 „2 , 234791545511 „ , 15616978311 
2880 1125899906842624 4398046511104 549755813888 34359738368 

1 4 I 23456248059223 3 , 1893603358947 2 , 62992853673 , 23192823403 
2880 ^ 2251799813685248 17592186044416 137438953472 34359738368 

1 4 I 11728124029611 3 i 946801679475 2 i 117395772757 , 2830502755 
2880 1125899906842624 " 8796093022208 274877906944 8589934592 

400319966877379 „4 , 11728124029609 „3 , 1893603358949 „2 , 31496426837 „ , 30541989663 
1152921504606846976 1125899906842624 17592186044416 68719476736 34359738368 

400319966877379 4 , 11728124029611 3 , 946801679473 2 , 117395772759 , 9717363505 
1152921504606846976 1125899906842624 "' 8796093022208 274877906944 "' 17179869184 

1 4 _L 2932031007403 3 _i_ 1893603358945 2 i 125985707353 , 4843768673 
2880 281474976710656 17592186044416 274877906944 8589934592 

400319966877379 „4 , 23456248059223 „3 , 59175104967 „2 , 117395772755 „ , 2830502755 
1152921504606846976 2251799813685248 549755813888 274877906944 8589934592 

400319966877379 4 , 23456248059221 3 , 946801679475 2 , 62992853675 , 3435973837 
1152921504606846976 ^ 2251799813685248 8796093022208 137438953472 4294967296 

400319966877379 4 , 23456248059223 „3 , 1893603358947 „2 , 58697886379 „ , 11244462985 
1152921504606846976 2251799813685248 17592186044416 137438953472 17179869184 

400319966877379 4 , 11728124029611 3 , 946801679475 2 , 15748213419 , 9687537337 
1152921504606846976 1125899906842624 8796093022208 34359738368 17179869184 

1 4 I 11728124029609 3 i 473400839737 2 , 117395772753 , 1892469965 
2880 1125899906842624 4398046511104 "' 274877906944 ^ 4294967296 

1 4 I 23456248059221 3 , 946801679473 2 , 7874106709 , 11835020991 
2880 2251799813685248 ''' 8796093022208 17179869184 17179869184 

400319966877379 „4 , 11728124029fill 3 , 473400839737 „2 _, 117395772753 „ , 3904244579 
1152921504606846976 ' TT2589990684M24 4398046511104 274877906944 8589934592 

400319966877379 4 , 11728124029611 3 , 946801679473 2 , 125985707349 , 1879048193 
L 1152921504606846976 ^ 1125899906842624 "' 8796093022208 274877906944 2147483648 -I 

Fi gure 6.9: The Hilbert quasipolynoniial of — C[xi, • • • , ] *=, A; = 5; the 
first 30 rows. 



r 1 4 I 11728124029609 3 i 946801679473 2 , 58697886375 , 88453211 -i 

2880 " 1125899906842624 8796093022208 " 137438953472 268435456 

1 4 I 11728124029611 3 , 946801679473 2 , 15748213419 , 2958755247 
2880 ^ 1125899906842624 "' 8796093022208 34359738368 ^ 4294967296 

400319966877379 4 , 23456248059223 „3 , 946801679475 „2 , 58697886375 „ , 4858681755 
1152921504606846976 2251799813685248 8796093022208 "' 137438953472 " 8589934592 

400319966877379 4 , 11728124029609 3 , 473400839737 2 , 62992853673 , 151367771 
1152921504606846976 1125899906842624 4398046511104 137438953472 " 268435456 

1 4 I 23456248059221 3 , 946801679473 2 _, 58697886375 , 2274244835 
2880 2251799813685248 8796093022208 137438953472 " 4294967296 

1 „4 I 11728124029611 „3 , 236700419869 „2 , 62992853671 „ , 858993459 
2880 "' 1125899906842624 "' 2199023255552 137438953472 1073741824 

400319966877379 4 , 11728124029611 3 , 946801679473 2 , 14674471595 , 3904244571 
1152921504606846976 1125899906842624 8796093022208 34359738368 8589934592 

400319966877379 4 , 23456248059219 3 , 59175104967 2 , 7874106709 , 2421884337 
1152921504606846976 2251799813685248 549755813888 17179869184 "' 4294967296 

400319966877379 „4 , 11728124029611 3 _i_ 59175104967 2 , 29348943189 i 3784939927 
1152921504606846976 1125899906842624 549755813888 68719476736 8589934592 

400319966877379 4 , 23456248059223 3 i 473400839737 2 , 62992853673 , 1908874355 
1152921504606846976 2251799813685248 ' 4398046511104 137438953472 2147483648 

400319966877379 4 , 5864062014805 3 , 946801679473 2 , 29348943189 , 1952122291 
1152921504606846976 562949953421312 8796093022208 68719476736 4294967296 

400319966877379 „4 , 11728124029609 „3 , 946801679471 „2 , 62992853675 „ , 2899102929 
1152921504606846976 1125899906842624 8796093022208 "' 137438953472 " 4294967296 

400319966877379 4 , 11728124029611 3 i 473400839735 2 , 58697886381 , 707625689 
1152921504606846976 1125899906842624 " 4398046511104 137438953472 2147483648 

400319966877379 4 , 11728124029613 „3 , 59175104967 „2 , 15748213419 „ , 2958755253 
1152921504606846976 1125899906842624 549755813888 34359738368 4294967296 

1 4 I 11728124029609 3 , 473400839737 2 , 58697886377 , 3288334339 
2880 1125899906842624 "' 4398046511104 137438953472 " 4294967296 

100079991719345 4 _i_ 5864062014805 3 , 59175104967 2 , 62992853675 , 1210942169 
288230376151711744 562949953421312 549755813888 137438953472 2147483648 

1 „4 I 11728124029611 „3 , 946801679477 „2 , 29348943193 „ , 1415251375 
2880 " 1125899906842624 8796093022208 " 68719476736 " 4294967296 

1 4 I 5864062014805 3 , 59175104967 2 , 31496426839 , 3435973835 
2880 562949953421312 "' 549755813888 ^ 68719476736 4294967296 

100079991719345 4 _i_ 1466015503701 3 , 473400839737 2 _i_ 29348943195 , 976061147 
288230376151711744 140737488355328 4398046511104 68719476736 2147483648 

100079991719345 „4 , 11728124029611 „3 , 473400839737 „2 , 31496426839 „ , 3280877793 
288230376151711744 1125899906842624 " 4398046511104 68719476736 4294967296 

1 4 I 5864062014805 3 , 946801679473 2 i 29348943191 , 946234983 
2880 562949953421312 8796093022208 68719476736 2147483648 

100079991719345 4 _i_ 2932031007403 3 , 946801679475 2 _i_ 15748213419 , 1479377623 
288230376151711744 281474976710656 ' 8796093022208 34359738368 ^ 2147483648 

1 „4 I 5864062014805 „3 , 59175104967 „2 , 29348943195 „ , 122007643 
2880 562949953421312 549755813888 " 68719476736 268435456 

100079991719345 4 , 2932031007403 3 , 473400839737 2 , 3937053355 , 1449551461 
288230376151711744 281474976710656 ^ 4398046511104 "' 8589934592 2147483648 

100079991719345 4 , 2932031007403 „3 , 236700419869 „2 , 29348943193 „ , 71070151 
288230376151711744 " 281474976710656 2199023255552 "' 68719476736 "' 134217728 

1 4 I 1466015503701 3 , 59175104967 2 , 15748213419 , 739688813 
2880 140737488355328 549755813888 34359738368 1073741824 

100079991719345 4 , 11728124029611 3 i 473400839739 2 , 14674471597 , 607335219 
288230376151711744 "' 1125899906842624 4398046511104 "' 34359738368 1073741824 

1 4 I 2932031007403 3 , 236700419869 2 , 3937053355 , 605471085 
2880 281474976710656 "' 2199023255552 "' 8589934592 1073741824 

100079991719345 „4 , 11728124029M4 3 , 473400839737 „2 , 29348943193 „ , 88453211 
288230376151711744 11258999068^2624 " 4398046511104 68719476736 ' 268435456 

100079991719345 4 , 1466015503701 3 i 473400839737 2 , 3937053355 , 2147483647 
L 288230376151711744 140737488355328 ' 4398046511104 "' 8589934592 2147483648 -I 



Figure 6.10: The Hilbert quasipolynomial of Tk = C[xi, . . . ,Xk\ k = 5; 
the last 30 rows. 



r 53375995583651 5 _i_ 21892498188609 4 , 418085902907 3 i 115486898397 2 , 26847522421 , 8448724291 -i 
4611686018427387904 36028797018963968 35184372088832 1099511627776 68719476736 17179869184 

53375995583651 „5 _i_ 10946249094305 4 , 836171805815 3 , 7396888121 2 , 15302809397 , 9853503363 
4611686018427387904 "' 18014398509481984 70368744177664 ''' 68719476736 ''' 34359738368 17179869184 

106751991167299 5 i 21892498188599 4 , 1672343611625 3 , 57743449207 2 _, 14060052663 , 975427339 
9223372036854775808 36028797018963968 "' 140737488355328 "• 549755813888 34359738368 2147483648 

13343998895913 „5 i 10946249094301 „4 , 1672343611641 3 _i_ 59175104961 „2 , 15302809423 „ , 610309549 
1152921504606846976 18014398509481984 140737488355328 ' 549755813888 34359738368 ' 1073741824 

106751991167305 5 , 21892498188611 4 , 1672343611623 3 , 115486898411 2 , 13423761203 , 4461910959 
9223372036854775808 36028797018963968 140737488355328 1099511627776 34359738368 8589934592 

13343998895913 5 , 21892498188605 4 , 1672343611631 3 , 29587552483 2 , 15939100865 , 1927366573 
1152921504606846976 36028797018963968 140737488355328 ^ 274877906944 34359738368 ^ 2147483648 

213503982334599 5 , 10946249094305 4 , 418085902909 3 _i_ 57743449199 2 , 13423761217 , 835973461 
18446744073709551616 18014398509481984 35184372088832 " 549755813888 " 34359738368 " 2147483648 

106751991167299 5 , 10946249094305 4 , 836171805821 3 , 59175104963 2 , 7651404713 , 320001575 
9223372036854775808 18014398509481984 70368744177664 " 549755813888 17179869184 " 536870912 

106751991167299 5 , 10946249094299 4 , 1672343611637 3 , 115486898395 2 , 14060052667 , 255936429 
9223372036854775808 18014398509481984 140737488355328 ^ 1099511627776 34359738368 ^ 536870912 

213503982334597 5 , 2736562273577 „4 , 1672343611629 „3 , 7396888121 2 , 7651404703 „ , 2859997491 
18446744073709551616 4503599627370496 "' 140737488355328 68719476736 " 17179869184 "' 4294967296 

106751991167299 5 i 342070284197 4 , 104521475727 3 , 57743449199 2 , 1677970153 , 1790721319 
9223372036854775808 562949953421312 8796093022208 549755813888 4294967296 4294967296 

1 5 _|_ 10946249094299 4 , 836171805815 3 , 59175104959 2 , 3984775219 , 987842475 
86400 18014398509481984 "' 70368744177664 "' 549755813888 8589934592 " 1073741824 

1 5 I 5473124547153 4 , 209042951453 3 , 57743449193 2 , 3355940307 , 884291849 
86400 "' 9007199254740992 " 17592186044416 549755813888 8589934592 2147483648 

106751991167303 5 , 10946249094301 4 , 836171805817 3 _i_ 118350209919 2 , 1912851173 , 264972307 
9223372036854775808 18014398509481984 70368744177664 " 1099511627776 4294967296 ' 536870912 

213503982334605 „5 , 2736562273577 „4 , 836171805827 „3 , 57743449201 „2 , 7030026327 „ , 1233125369 
18446744073709551616 ^ 4503599627370496 ' 70368744177664 " 549755813888 17179869184 " 2147483648 

53375995583651 „5 , 10946249094299 „4 , 836171805819 „3 , 118350209933 „2 , 1912851177 „ , 1478317113 
4611686018427387904 18014398509481984 "' 70368744177664 "' 1099511627776 " 4294967296 "' 2147483648 

106751991167297 5 _, 1368281136787 4 , 836171805817 3 , 57743449195 2 , 1677970151 , 117959881 
9223372036854775808 2251799813685248 70368744177664 " 549755813888 4294967296 268435456 

1667999861989 5 , 10946249094303 4 , 104521475727 3 , 59175104961 2 , 3984775215 , 109722991 
144115188075855872 18014398509481984 8796093022208 549755813888 8589934592 134217728 

106751991167297 5 , 342070284197 4 , 836171805815 3 , 28871724597 2 , 1677970153 , 332087389 
9223372036854775808 562949953421312 70368744177664 "' 274877906944 4294967296 1073741824 

213503982334607 5 , 10946249094307 4 i 836171805821 3 , 59175104963 2 , 7651404709 , 384426083 
L 18446744073709551616 18014398509481984 " 70368744177664 549755813888 17179869184 536870912 



Figure 6.11: The Hilbert quasipolynomial of = C[xi, . . . ,Xk]^'', k = 6; the first 20 rows. 



r 213503982334615 5 , 10946249094307 4 , 836171805813 3 _i_ 28871724597 2 , 7030026337 , 640721865 -i 

18446744073709551616 18014398509481984 70368744177664 " 274877906944 "' 17179869184 " 1073741824 

106751991167309 „5 , 10946249094297 4 , 209042951455 3 , 29587552479 2 , 1912851179 , 157275009 

9223372036854775808 " 18014398509481984 17592186044416 274877906944 ''' 4294967296 268435456 

26687997791827 5 i 342070284197 4 , 836171805825 3 , 57743449199 2 , 3355940301 , 90445245 

2305843009213693952 562949953421312 "' 70368744177664 "' 549755813888 8589934592 268435456 

13343998895913 „5 i 5473124547153 „4 i 104521475729 „3 _i_ 29587552481 „2 , 1992387605 „ , 450971557 

1152921504606846976 9007199254740992 " 8796093022208 274877906944 4294967296 536870912 

106751991167303 5 , 10946249094307 4 , 836171805827 3 , 28871724597 2 , 209746269 , 17843591 

9223372036854775808 18014398509481984 70368744177664 274877906944 536870912 33554432 

106751991167303 5 i 10946249094297 4 i 836171805819 3 , 924611015 2 , 239106397 , 5146825 

9223372036854775808 ^ 18014398509481984 70368744177664 " 8589934592 536870912 "' 8388608 

1667999861989 5 i 5473124547153 4 i 418085902911 3 , 7217931151 2 , 54922081 , 265331665 

144115188075855872 9007199254740992 " 35184372088832 68719476736 134217728 536870912 

1667999861989 5 , 10946249094291 4 , 836171805825 3 , 59175104963 2 , 478212795 , 326629601 

144115188075855872 18014398509481984 70368744177664 " 549755813888 1073741824 536870912 

1667999861989 5 , 10946249094297 4 , 418085902909 3 , 14435862303 2 , 3355940305 , 24121261 

144115188075855872 18014398509481984 35184372088832 " 137438953472 " 8589934592 "' 67108864 

53375995583655 5 , 10946249094291 „4 , 209042951453 „3 , 59175104973 „2 , 3984775217 „ , 503316475 

4611686018427387904 18014398509481984 17592186044416 549755813888 8589934592 "' 536870912 

26687997791827 5 , 10946249094285 4 , 836171805825 3 , 57743449207 2 , 3355940305 , 115234099 

2305843009213693952 ^ 18014398509481984 ^ 70368744177664 549755813888 8589934592 268435456 

106751991167303 5 , 2736562273573 4 , 209042951459 3 , 7396888121 2 _, 3825702363 , 42684549 

9223372036854775808 4503599627370496 17592186044416 ^ 68719476736 ^ 8589934592 "' 67108864 

106751991167301 „5 , 10946249094305 4 , 209042951453 3 , 28871724605 2 , 1757506587 , 277411267 

9223372036854775808 ^ 18014398509481984 ''' 17592186044416 " 274877906944 4294967296 536870912 

106751991167303 5 i 10946249094299 4 , 418085902905 3 _i_ 924611015 2 , 3825702353 , 33950041 

9223372036854775808 18014398509481984 35184372088832 8589934592 8589934592 67108864 

106751991167307 „5 , 1368281136787 „4 , 52260737865 „3 , 28871724601 „2 _, 209746269 „ , 61328751 

9223372036854775808 2251799813685248 4398046511104 274877906944 536870912 " 134217728 

53375995583651 „5 , 2736562273575 „4 , 104521475727 „3 , 29587552487 „2 , 249048451 „ , 128849017 

4611686018427387904 4503599627370496 " 8796093022208 "• 274877906944 536870912 134217728 

106751991167301 5 _i_ 5473124547145 4 , 209042951459 3 i 7217931151 2 , 1677970157 , 30318473 

9223372036854775808 9007199254740992 17592186044416 " 68719476736 4294967296 67108864 

106751991167303 5 i 342070284197 4 , 418085902919 3 , 14793776243 2 , 1912851181 , 143223581 

9223372036854775808 562949953421312 "' 35184372088832 "' 137438953472 4294967296 268435456 

53375995583651 5 , 5473124547153 4 , 209042951459 3 , 1804482787 2 , 878753295 , 13898875 

4611686018427387904 9007199254740992 17592186044416 ^ 17179869184 2147483648 " 33554432 

106751991167303 5 , 5473124547147 4 , 418085902907 3 , 29587552479 2 , 956425585 , 195527051 

L 9223372036854775808 9007199254740992 35184372088832 " 274877906944 " 2147483648 268435456 



Figure 6.12: The Hilbert quasipolynomial of = C[xi, . . . k = 6; the middle 20 rows. 



r 13343998895913 5 i 5473124547145 4 , 418085902919 3 i 7217931149 2 , 209746269 , 64348647 -r 

1152921504606846976 9007199254740992 35184372088832 " 68719476736 " 536870912 134217728 

53375995583651 „5 _i_ 5473124547143 4 , 104521475729 3 , 14793776237 2 , 498096901 , 28772927 

4611686018427387904 9007199254740992 8796093022208 ^ 137438953472 " 1073741824 33554432 

106751991167301 5 , 5473124547141 4 , 209042951457 3 , 3608965575 2 _, 1677970153 , 11719905 

9223372036854775808 9007199254740992 17592186044416 34359738368 ^ 4294967296 " 33554432 

13343998895913 „5 i 5473124547151 „4 i 418085902905 „3 , 3698444059 „2 , 478212797 „ , 74631683 

1152921504606846976 9007199254740992 " 35184372088832 34359738368 1073741824 134217728 

106751991167311 5 , 5473124547147 4 , 418085902907 3 , 28871724591 2 , 878753299 , 10682367 

9223372036854775808 9007199254740992 ^ 35184372088832 274877906944 2147483648 16777216 

106751991167313 5 _i_ 5473124547151 4 , 104521475729 3 , 14793776237 2 , 478212797 , 84006215 

9223372036854775808 9007199254740992 8796093022208 137438953472 1073741824 134217728 

106751991167307 5 i 2736562273573 4 , 209042951459 3 _, 28871724589 2 , 104873135 , 3161957 

9223372036854775808 4503599627370496 17592186044416 274877906944 268435456 8388608 

53375995583655 5 , 5473124547149 4 , 209042951451 3 , 29587552485 2 , 996193803 , 118111589 

4611686018427387904 9007199254740992 17592186044416 " 274877906944 2147483648 134217728 

106751991167309 5 _, 1368281136787 4 , 418085902907 3 , 28871724601 2 , 419492539 , 49899533 

9223372036854775808 2251799813685248 35184372088832 "• 274877906944 1073741824 "' 134217728 

106751991167305 5 _i_ 2736562273573 „4 , 52260737863 „3 , 29587552479 „2 , 1912851173 „ , 87717907 

9223372036854775808 4503599627370496 4398046511104 "' 274877906944 " 4294967296 134217728 

106751991167309 5 _i_ 1368281136787 4 _, 104521475729 3 , 28871724595 2 _, 878753303 , 8962701 

9223372036854775808 2251799813685248 8796093022208 274877906944 ^ 2147483648 16777216 

106751991167305 5 i 2736562273571 4 , 209042951453 3 , 29587552499 2 , 956425585 , 10878263 

9223372036854775808 4503599627370496 ' 17592186044416 274877906944 " 2147483648 16777216 

53375995583651 „5 , 5473124547157 4 , 104521475727 3 , 3608965575 2 , 838985083 , 53611225 

4611686018427387904 9007199254740992 " 8796093022208 34359738368 2147483648 134217728 

13343998895913 5 _, 5473124547145 4 , 418085902907 3 _i_ 14793776249 2 , 498096903 , 104354293 

1152921504606846976 9007199254740992 35184372088832 " 137438953472 " 1073741824 134217728 

106751991167299 „5 , 2736562273575 „4 _, 209042951447 „3 , 3608965575 „2 _, 838985087 „ , 7873221 

9223372036854775808 4503599627370496 17592186044416 34359738368 ^ 2147483648 ' 16777216 

106751991167303 „5 , 5473124547151 „4 , 418085902899 „3 , 14793776243 „2 , 956425599 „ , 90737805 

9223372036854775808 "' 9007199254740992 " 35184372088832 137438953472 2147483648 "' 134217728 

53375995583655 5 _i_ 5473124547155 4 , 104521475727 3 , 14435862303 2 , 878753295 , 18680385 

4611686018427387904 9007199254740992 8796093022208 137438953472 2147483648 33554432 

106751991167305 5 i 2736562273573 4 , 104521475725 3 , 3698444063 2 , 478212799 , 36634403 

9223372036854775808 4503599627370496 8796093022208 34359738368 1073741824 67108864 

106751991167311 5 , 684140568395 4 , 209042951463 3 , 7217931153 2 , 52436567 , 19926951 

9223372036854775808 ^ 1125899906842624 17592186044416 " 68719476736 134217728 67108864 

26687997791827 5 i 1368281136789 4 , 6532592233 3 , 14793776243 2 , 498096903 , 67108871 

2305843009213693952 2251799813685248 549755813888 137438953472 1073741824 67108864 

Figure 6.13: The Hilbert quasipolynomial of T^. = C[xi, . . . ,Xk]^'', k = 6; the last 20 rows. 



Chapter 7 



On verification and discovery 
of obstructions 

In this chapter we give apphcations of the results and positivity hypotheses 
in this paper to the problem of verifying or discovering an obstruction, i.e., 
a "proof of hardness" |GCT2j in the context of the P vs. NP and the 
permanent vs. determinant problems in characteristic zero. 

7.1 Obstruction 

An obstruction in an abstract setting of Problem ll.l.4l is defined as follows. 

Let X and Y be i7- varieties with compact specifications (Section 13. 5p . 
H a connected reductive group. Let {X) and (Y) denote the bit lengths of 
their specifications (Section 13. Sh . Suppose we wish to show that X cannot 
be embedded as an ff-subvariety of Y. Pictorially: 

X y^Y. (7.1) 

For example, in the context of the P vs. NP problem in characteristic 
zero [GCTH IGCT2j . X is a class variety Xiyp{n,l) associated with the 
complexity class NP for the given input size parameter n and the circuit 
size parameter /. The variety Y is the class variety Xp{l) associated with 
the class P for given /. And H is SLi{C). U NP C P (over C) to the 
contrary, then it would turn out that 

XNp{n,l)^Xp{l) 
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as an i7-subvariety, for every / = poly(n). The goal is to show that this 
embedding cannot exist when I = poly(n) and n ^ oo. 

Let R{X) and RiY) be the homogeneous coordinate rings of X and 
y, respectively. Let R{X)(i and R(Y)fi denote their degree d-compoenents. 
Suppose to the contrary that an iJ-embedding as in (j7.ip exists. Then there 
exists a degre preserving iJ-equivariant surjection from R{Y)d to R{X)d for 
every d, and hence, a degree-preserving iif-equivariant injection from R{X)*^ 
to R{Yy^. Hence, every irreducible //-module V\{G) that occurs in R{X)*^ 
also occurs in R{Y)*^. This leads to: 

Definition 7.1.1 An irreducible representation Vx{H) is called an obstruc- 
tion for the pair (X,Y) if it occurs (as an H-suhmodule) in R{X)'^ but not 
in for some d. We say that V\{H) is an obstruction of degree d. 

Remark 7.1.2 The obstruction as defined here is dual to the obstrution as 
defined in \GCT^ . 

Existence of such an obstruction implies that X cannot be embedded in 
Y as an i/-subvariety. 

Let us assume that X and Y are i/-subvarieties of P{V), where V is an 
i/-module, and that we are given a point y (zY CI P{V) that is distiguished 
in the following sense. Let Hy Q H he the stabilizer of y. Then Cy, the line 
in V corresponding to y, is invariant under Hy. Let [y] be the set of points 
in P{V) stabilized by Hy. We say that y is characterized by its stabilizer Hy 
if y = [y]; i.e., y is the only point in P{V) stabilized by Hy. Let 

H[y] = ^ze[y]Hz 

be the union of the //-orbits of all points in [y]. We say that y is a distin- 
guished point of y if y equals the projective closure of H[y] in P{V). If y 
is characterized by its stabilizer, this means Y is the projective closure of 
the orbit Hy of y. 

If V\{H) occurs in R{Y)^, then it can be shown (cf. Proposition 4.2 in 
|GCT2j ) that Vx{H) contains an //j^-submodule isomorphic to {Cy)'^, the 
d-th tensor power of Cy. This leads to the following stronger notion of 
obstruction: 

Definition 7.1.3 \GCT0^ We say that Vx{H) is a strong obstruction for 
the pair (X, Y) if, for some d, it occurs in R[X)*^, but it does not contain 
an Hy-module isomorphic to (Cy)"^. 
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Existence of a strong obstruction also implies that X cannot be embedded 
in Y as an ff-subvariety. The results in |GCT2j suggest that strong obstruc- 
tions exist in the context of the lower bound problems under cosideration. 
The goal then is to show their existence. 

7.2 Decision problems 

The decisions problems that arise in this context are the following. Let 
be the multiplicity of Vx{H) in R{X)'^, and the multiplicity of the Hy- 
module (Cy)'^ in Vx{H), considered an Hy-modnle via the the embedding 
p : Hy ^ H. Thus A is a strong obstruction of degree d iff is nonzero 
and is zero. 

Problem 7.2.1 (Decision Problems) 

(a) Given d,X and the specification of X, decide if s^ is nonzero. 

(b) Given d, A and the specifications of H, Hy and p, decide ifm'l is nonzero. 

(c) Given d,\ and the specifications of X,H,Hy and p, decide if X is a 
strong obstruction of degree d. 

The first is an instance of the decision Problem 11.1.41 in geometric in- 
variant theory, and the second of the subgroup restriction Problem 11.1.31 
By the results in Chapter [SJIU relaxed forms of the decision problems in (a) 
and (b) belong to P assuming appropriate PHI and SH; this implies that 
a relaxed form of the decision problem in (c) also belongs to P assumming 
PHI and SH. We will only need a weak relaxed form of (c), for which the 
weak form of SH that is implied by PHI (cf. Theorem I3.3.5P will suffice. 

7.3 Verification of obstructions 

The relevant PHI are as follows. 

Assume that that singularities of spec(i?(X)) are rational. By Theo- 
rem [33TT1 the stretching function s^{k) = s^^ is a quasipolynomial. Hence 
PHI for (Hypothesis 13.3. n or rather its slight variant obtained by replac- 
ing R{X)d with R{X)*^) is well defined. It is: 

Hypothesis 7.3.1 (PHI): 

There exists a polytope P^ such that: 
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1. The number of integer points in is equal to s^. 

d 



2. The Ehrhart quasi-polynomial of coincides with the stretching quasi- 



polynomial s^{n) (cf. Theorem \3. 5.1\) . 

3. The polytope P^ is given by a separating oracle, as in Section \2. 31 Its 
encoding bitlength (Pj^) is poly{{d), (A), {X)), and the combinatorial 
size \\P^\\ is poly{ht{X), \\X\\), where \\X\\ is the combinatorial size of 
X (Section \3.5\) . and ht{\) is the height of X. 

Similarly by Theorem 13.4.11 (or rather its slight variant which can be 
proved similarly), the stretching function m^^ is a quasipolynomial. Hence 
PHI for (cf. Hvpothesis 13.3. Il and Section [3. 4p is also well defined. It is: 

Hypothesis 7.3.2 (PHI:) 

There exists a polytope Qf such that: 

1. The number of integer points in Q'^ is equal to m^. 

2. The Ehrhart quasi-polynomial ofQ'l coincides with the stretching quasi- 
polynomial 77i^(n) (Theorem \3. 5.1\) . 

3. The polytope Qf is given by a separating oracle. Its encoding bitlength 
{Q\) poly{{d), (A), (p), (Hy), {H)), and the combinatorial size \\Qx\\ 
is 0{poly{ht{X), (H), (Hy), (p))). Here {H),{IIy) and (p) denote the 
bitlengths of H,Hy and p fSection \3.4\ )- 



Theorem 7.3.3 (Weak SH:) 

(a) Assuming PHI ( Hypothesis \ 7.3.1 ), the saturation index of s'^{n) is at 
most a^'^^^'^ll^dll), for some explicit constant a > 0. 

(b) Assuming PHI ( Hypothesis \7.3.2 ), the saturation index of rh'j^{n) is at 
most ft^'^^ydl'^All)^ for some explicit constant b > 0. 

This follows from Theorem 13.3.51 

Theorem 7.3.4 Assume PHI (Hypotheses |7.3. j[f7^01 ). Then, given d, X, 
the specifications of X, H, Hy and p, and a relaxation parameter c greater 
than the explicit bounds on the saturation indices in Theorem 7.3.3, whether 
cX is an obstruction of degree d can be decided in 

poly{{d),{X),{X),{H),{Hy),{p),{c)) 

time. 
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This follows by applying Theorem 13.1.11 to the polytopes and with 
the saturation index estimates in Theorem 17.3.31 

7.4 Robust obstruction 

We now define a notion of obstruction that is weh behaved with respect to 
relaxation. 

Definition 7.4.1 Assume PHI for both s^ and mf (Hypotheses\T3l^(TT^. 
We say that Vx{H) is a robust obstruction for the pair {X,Y) if one of the 
following hold: 

1. Qf^ is empty, and P^ is nonempty. 

2. Both Q'^X and P^ are nonempty, the affine span ofQf does not contain 
an integer point and the affine span of P^ contains an integer point. 

If Vx{H) is a robust obstruction, so is Vi\{H), for all or most positive 
integral I, hence the name robust. 

Proposition 7.4.2 Assume PHI for both s^ and as above. If Vx{H) 
is a robust obstruction for the pair {X,Y), then for some positive integer 
k-called a relaxation parameter-Vk\{H) is a strong obstruction for {X,Y). 
In fact, this is so for most large enough k. 

Proof: 

(1) Suppose is empty, and P^ is nonempty. Let A; be a large enough 
positive integer k such that kP^ = P^^ contains an integer point. Then sj:^ 
is nonzero. But m^^ is zero since Qj^^ = kQf^ is empty. Thus kX is a strong 
obstruction. 

(2) Suppose both Q'^X and P^ are nonempty, the affine span of Qf does not 
contain an integer point and the affine span of P^ contains an integer point. 
We can choose a positive integer k such that the affine span of kQj^ = Q'j^ 
does not contain an integer point, but kP^ = P^^ contains an integer point; 
most large enough k have this property. This means s^^ is nonzero, but m^^ 
is zero. Thus kX is a strong obstruction. Q.E.D. 
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7.5 Verification of robust obstructions 



Theorem 7.5.1 Assume that the singularities of spec{R{X)) are rational. 
Assume PHI for both s^ and as above. Then, given A, d and the speci- 
fications of p : Hy ^ H and X, whether V\{H) is a robust obstruction can 
be verified in poly{{p), (Hy), {H), {X), (d), (A)) time. Furthermore, a positive 
integral relaxation parameter k such that Vkx{G) is a strong obstruction can 
also be found in the same time. 

The crucial result used implicitly here is the quasipolynomiality theorem 
(Theorem I4.1.ip because of which PHI for both s^ and are well defined. 

Proof: By linear programming [GLSj . whether is nonempty or not can 
be determined in poly{{Qf)) = po\y{{p) , (Hy), {H) , (d), {X)) time. If it 
is nonempty, the linear programming algorithm also gives its affine span. 
Whether this contains an integer point can be determined in polynomial 
time, using the polynomial time algorithm for computing the Smith normal 
form, as in the proof of Theorem 13.1.11 

Similarly, whether P^ is nonempty or not can be determined in poly((P^)) = 
poly((X), {d), (A)) time. If it is nonempty, whether its affine span contains 
an integer point can be determined in polynomial time similarly. Further- 
more, the algorithm can also be made to return a vertex v of the polytope 
P^ if it is nonempty. 

Using these observations, whether Vx{G) is a robust obstruction can be 
determined in polynomial time. 

As far as the computation of the relaxation parameter k is concerned, 
let us consider the second case in Definition 17.4. ll -when both Qf and P^ are 
nonempty, the affine span of Qf does not contain an integer point and the 
affine span of P^ contains an integer point-the first case being simpler. In 
this case, by examining the Smith normal forms of the defining equations 
of the affine spans of P^ and Qf^ and the rational coordinates of a vertex 
V G P^, we can find a large enough k so that the affine span of Q^f^ does not 
contain an integer point, the affine span of P^^ contains an integer point, 
and P^^ contains an integer point that is some multiple of v. Q.E.D. 

The value of the relaxation parameter k computed above is rather con- 
servative. One may wish to compute as small value of k as possible for 
which Vk\{G) is a strong obstruction (though in our application this is not 
necessary). If SH for holds for the structural constant (cf. Hypothe- 
sis [332] and Section [33]) . then we can let k be the smallest integer larger 
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than the saturation index (estimate) for such that affine span of (if 
nonempty) does not contain an integer point (as can be ensured by looking 
at the Smith normal of the defining equations of the affine span) . 

7.6 Arithemetic version of the P*P vs. NC prob- 
lem in characteristric zero 

We now specialize the discussion in the preceding sections in the context 
of the arithmetic form of the vs. NC problem in characteristric zero 
[y] . In concrete terms, the problem is to show that the permanent of an 
nxn complex matrix X cannot be expressed as a determinant of an m x m 
complex matrix, whose entries are (possibly nonhomogeneous) linear com- 
binations of the entries of X. 

7.6.1 Class varieties 

The class varieties in this context are as follows [GCTlj . Let Y be an m x m 
variable matrix, which can also be thought of as a variable /-vector, / = m?. 
Let X be its, say, principal bottom-right nxn submatrix, n < m, which 
can be thought of as a variable /c- vector, k = n^. Let V = Sym"*(y) be the 
space of homogeneous forms of degree m in the variable entries of Y . The 
space V , and hence PiV), has a natural action of G = GL{Y) = GLi{C) 
given by 

{af){Y) = f{a-'Y), 

for any f V , a ^ G, and thinking of Y as an /-vector. Let W = Sym"'{X) 
be the space of homogeneous forms of degree n in the variable entries of 
X. The space W, and also P{W), has a similar action oi K = GL(X) = 
GLk{C). We use any entry y oiY not in X as the homogenizing variable 
for embedding in 1/ via the map (p : W ^ V defined by: 

</>(/i)(y) = y— "M^), (7.2) 

for any h{X) S W. We also think of as a map from P{W) to P{V). 

Let g = det(y) G P{y) be the determinant form, and / = 4>{h), where 
h = perm(X) G P{W). Let Av[g],Av[f] Q PiV) be the projective closures 
of the orbits Gg and Gf, respectively, in P{V). Let Avi/[/i] Q P{W) be the 
projective closure of the iC-orbit Kh of h in P{W). Then Ay[(/] is called the 
class variety associated with NG and Av[/] the class variety associated with 
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P"^^; Aw[h] is called the base class variety associated with P*^. (The base 
class variety is not used in what follows. Rather its variant, called a reduced 
class variety defined below, will be used.) These class varieties depend on 
the lower bound parameters n and m. If we wish to make these explicit, we 
would write Ay[/, n, m] and Ay[g,m] instead of Ay[/] and A\/[5r]. 

The class varieties Ay [(7] = Av[g,m] and Ay[/] = A\/[/, n,m] are 
G-subvarieties of P{V), and their homogeneous coordinate rings -Ry[9] = 
Rv[g,m] and Rv[f] = Rv[f,n'iiT^] have natural degree-preserving G-action. 

It is conjectured in |GCT1| that, if m = poly(n) and n — > 00, then 
/ Ay[g(]; this is equivalent to saying that the class variety Ay[/, n,m] 
cannot be embedded in the class variety Ay[5(,m] (as a subvariety). This 
implies the arithmetic form of the ^ NC conjecture in characteristic 
zero. 

7.6.2 Obstructions 

The obstruction in this context is defined as follows. A G- module V\{G) is 
called an obstruction for the pair {f,g) if it occurs in i?y[/, n, m]^ but not 
Rv[g, Tnld for some d. It is called a strong obstruction if, for some d, it occurs 
in Rv[f,n,m]'^ but it does not contain {Cg)'^ as a G^-submodule, where 
(Cg) C V denotes the one dimensional line corresponding to g, and Gg Q G 
is the stabilizer of g' = det(y) € P{V). If V\{G) is a (strong) obstruction 
of degree d, then the size |A| = dm; hence d is completely determined by A 
and m. 

Existence of an obstruction or a strong obstruction implies that the 
class variety Ay[/, n,m] cannot be embedded in the class variety Av[g,m], 
as sought. The main algebro-geometric results of |GCTH IGCT2j suggest 
that strong obstructions should indeed exist for all n — > 00, assuming m = 
poly(?i); cf. Section 4, Conjecture 2.10 and Theorem 2.11 in |GCT2j . The 
goal then is to prove existence of strong obstructions for all n. 

The definition of a strong obstruction can be simplified further as follows. 
Let X' denote the set of variables, which consists of the variable entries in 
X and the homogenizing variable y above. Let W' = Sym™(X') Q V = 
Sym'"(y) be the space of homogeneous forms of degree m in the variables 
of X'. We have a natural action of H = GL{X') = GL„2+i(C) on W' 
and hence on P{W'). We have a natural map (/)' : W ^ W' given by 
(j)'{h){X') = 2/™-"/i(X). The map cf) in (USD is (/>' followed by the inclusion 
from W' to V. We also think of (p' as a map from P{W) to P{W'). 
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Let /' = ^'{h), for h = perm(X) G P{W). Let Aw'[f'] ^ PiW) be 
the orbit closure of Hf. It is an i/-subvariety of P{W'), and hence its 
homogeneous coordinate ring Rw[f'] has the natural degree preserving H- 
action. We call Aiy/[/'] the reduced class variety for P*^. It is known (cf. 
Theorem 8.2 in |GCT20 that Vx{G) occurs in Rv[f]*d iff Vx{H) occurs in 
Rw'if'jd- Here the dominant weight A of G is considered a dominant weight 
of H by restriction from G to H. 

Hence V\{G) is a strong obstruction for the pair {f,g), iff for some d, 
V\{H) occurs in Rw'[f']d ^ -ff-submodule and Vx{G) does not contain 
(Cg)'^ as a G^-submodule. In particular, we can assume without loss of 
generality that the height of the Young diagram for A is at most + 1; 
otherwise Vx{H) would be zero. 

7.6.3 Robust obstructions 

It is known that the stabilizer Gg of g = det(y) E P{V) consists of lin- 
ear transformations in G of the form Y — > AY*B~^, thinking of Y as an 
m X m matrix, where Y* is either Y or y^, A, B G GLm{C). Thus the con- 
nected component of Gg is essentially GLm(C) x GLm(C) C G = GL/(C) = 
GL^2(C). This means the subgroup restriction problem for the embedding 
p : Gg ^ G is essentially the Kronecker problem (Problem ll.l.ip . 

Assume PHI (Hvpothesis l7.3.2] ) for the subgroup restriction p : Gg ^ G; 
which is essentially PHI for the Kronecker problem. It now assumes the 
following concrete form. Let denote the multiplicity of the G^-module 
(Cg)'^ in Vx{G). Assume that the height of A is at most v? + 1 for the reasons 
give above. 

Hypothesis 7.6.1 (PHI:) 

There exists a polytope Qf such that: 

1. The number of integer points in Q'^ is equal to m^. 

2. The Ehrhart quasi-polynomial ofQf^ coincides with the stretching quasi- 
polynomial mf(n) (cf. Theorem \3. 5.1\) . 

3. The polytope Qf is given by a separating oracle, and its encoding 
bitlength (Qf) is poly{n, (m), (d), (A)) time. 

We have to explain why {Qx) is stipulated to depend polynomially on 
n and (m), rather than m. After all, the bitlengths (G), {Gg) and (p) are 
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0(poly(m^)) as per the definitions in Section [3.4i So, as per PHI for sub- 
group restriction in Section 13.4.31 (Q^) sliould depend polynomially on m. 
We are stipulating a stronger condition for the fohowing reason. First, as we 
already mentioned, the above hypothesis is essentially PHI for the Kronecker 
problem, which is obtained by specializing PHI for the plethysm problem 
(Hypothesis 11.6.4]) . In Hypothesis 11.6.41 the encoding bitlength of the poly- 
tope depends polynomially on the bitlengths of the various partition param- 
eters A, vr, /X of the plethysm constant ^, but is independent of the rank of 
the group G therein. (As explained in the remarks after Hypothesis 11.6.41 
this is justified because the bound in Theorem 11.6.31 is also independent of 
the rank of G). For the same reason, the encoding bitlength of the polytope 
here should be independent of the rank of G (which is m?), but should de- 
pend polynomiallly on the total bit length of the partitions parametrizing 
the representations Vx{G) and {Cy)'^. This is 0{n + {m) + (d) + (A)). (Note 
that the one dimensional representation (Cy)'^ of Gg is essentially the d-th. 
power of the determinant representation of Gg, since the connected compo- 
nent of Gg is isomorphic to GLm{C) x GLm{C). The Young diagram for the 
partition corresponding to the d-th power of the determinant representation 
of GLm(C) is a rectangle of height m and width d. It can be specified by 
simply giving m and d-this specification has bit length (m) + {d).) 

Next let us specialize PHI as per Hypothesis 17.3.11 The class variety 
A\/[/] = A[/, n,m] will now play the role of X in Hypothesis 17.3.11 But, 
for the reasons explained in the proof of Proposition 17.6.41 below, we shall 
instead specialize Hypothesis 17.3.11 to the (simpler) reduced class variety 
Z = Aty/[/']. It now assumes that following concrete form. Let denote 
the multiplicity of V\{H) in Rw'[f']d- Putting Z in place of X in Hypothe- 
sis 17.3.11 we get: 

Hypothesis 7.6.2 (PHI): 

There exists a polytope such that: 

1. The number of integer points in is equal to s^. 

2. The Ehrhart quasi-polynomial of P^ coincides with the stretching quasi- 
polynomial s^(n) (cf. Theorem \3. 5.1\) . 

3. The polytope P^ is given by a separating oracle, and its encoding 
bitlength {P^) is 

poly{{d),{X),{Z)) = poly{ (d) , ( A) , n, (m) ) . (7.3) 
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Here (|7.3p follows because (Z) = n + {m). To see why, let us observe that 
Z = A\Y'[f'] is completely specified once the point /' = y™""/! s P{W') is 
specified. To specify /', it sufficies to specify m,n and the point h S P{W). 
It is known |GCT2j that the point h = perm(X) G P{W) is completely 
characterized by its stabilizer Kf^ ^ K = GL{X) = GLk{C). Furthermore, 
Kh is explicitly known [Mcj . It is generated by the linear transformation in 
K of the form X — > AX//~^, thinking of X as an n x n matrix, where A and 
jjL are either diagonal or permutation matrices. So to specifiy h, it suffices 
to specify K^^K and the embedding p' : ^ K. The bit length of this 
specification is 0(n) (cf. Section [3. 4p . To specify and hence it suffices 
to specify m, n, and p'. The total bit length of this specification is 

0(n + (m)). 

Assume PHI for both and s^, i.e.. Hypotheses 17.6.1) and [716121 

Definition 7.6.3 We say that Vx{G) is a robust obstruction for the pair 
if 7 7 9) "if one of the following hold: 

1. Qf is empty, and is nonempty. 

2. Both Qf and P^ are nonempty, the affine span of Qf does not contain 
an integer point and the affine span of P^ contains an integer point. 

If the first condition holds, we say that V\{G) is a geometric obstruction. 
// the second condition holds, it is called a modular obstruction. 



Proposition 7.6.4 Assume PHI for both m'l and s^ ( Hypotheses \ 7. 6. i\ and 



\7.6.2^ . If Vx{G) is a robust obstruction for the pair {f,g), then for some 
positive integral relaxation parameter k, Vkx{G) is a strong obstruction for 
{f,g). In fact, this is so for most large enough k. 

Proof: This essentially follows from Proposition 17.4.21 It only remains to 
clarify why we can use PHI for the reduced class variety Aty'[/']^^s we are 
doing here- in place of PHI for the class variety Av[/]. This is because, 
as already mentioned, Vx{G) occurs in Rv[f]d i^ ^xiH) occurs in Rw'[f']d- 
Q.E.D. 

7.6.4 Verification of robust obstructions 

Theorem 7.6.5 Assume that the singularities of spec{Rw[f']) are ratio- 
nal. Assume PHI for both mf and s^ as above ( Hypotheses \7.6.1\ and 7.6.2). 
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Then, given n,m, A and d, whether V\{H) is a robust obstruction can be 
verified in poly{n, (m), {d), (A)) time. Furthermore, a positive integral relax- 
ation parameter k such that kX is a strong obstruction can also be computed 
in this much time. 

Once n and m are specified, the various class varieties and K, Kh, p' , G, Gg, p 
above are automatically specified implicitly. 

Proof: This follows from Theorem 17.5.11 cf. also the remark following its 
proof. Q.E.D. 

Theorem 17.3.41 can be similarly specialized in this context; we leave that 
to the reader. 



7.6.5 On explicit construction of obstructions 
Theorem 7.6.6 Assume that m = poly{n) or even 2P'^^y^^3^^\ and: 

1. (RH) [Rationality Hypothesis]: The singularities of spec{R\[ri[f']) are 
rational. 

2. PHI for both mf and sj (Hypotheses\T6l\and\T6^. 

3. OH [Obstruction Hypothesis]: For every (large enough) n, there exists 
A of poly{n) bit length such that |A| is divisible by m and one of the 
following holds (with d = \\\/m): 

(a) Qf^ is empty, and P^ is nonempty. 

(b) Both Q'^X and P^ are nonempty, the affine span of Q'^ does not 
contain an integer point and the affine span of P^^ contains an 
integer point. 

Then there exists an explicit family {A„} of robust obstructions. 



Here we say that {A^} is an explicit family of robust obstructions if each 
Xn is short and easy to verify. Short means (A^) is 0(poly(n)). Easy to verify 
means whether A„ is a robust obstruction can be verified in 0(poly(n)) time. 

The poly(n) bound here and in OH is meant to be independent of m, 
as long as m « 2"; i.e., it should hold even when m = 

2Polylog(n)_ 

other words, the family {A^} should continue to remain an explicit robust 
obstruction family, as we vary m over all values < 2P°^y^°S{")^ and perhaps 
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even values < 2°("), but will cease to be an obstruction family for some large 
enough m = 2^("). This is an important uniformity condition. 

Proof: OH basically says that there exists a short robust obstruction A„ for 
every n. By Theorem 17.6.51 it is easy to verify. Q.E.D. 

7.6.6 Why should robust obstructions exist? 

The main question now is: why should OH hold? That is, why should 
(short) robust obstructions exist? 

As we already mentioned, the results in |GCTH IGCT2j indicate that 
strong obstructions should exist for every n, assuming m = poly(n). We 
shall give a heuristic argument for existence of robust obstructions assuming 
that strong obstructions exist. This will crucially depend on the following SH 
for m^, which is essentially SH for the Kronecker problem (i.e. specialization 
of Hypothesis 11.6.51 to the Kronecker problem) , good experimental evidence 
for which is provided in |BORj . 

Hypothesis 7.6.7 (SH:) (a): The saturation index ofm'^{k) is bounded by 
a polynomial in m. (Observe that the rank of G is poly{m) and the height of 
X is at most n"^ + 1). (b): The quasi-polynomial m'l{n) is strictly saturated, 
i.e. the saturation index is zero, for almost all A (and d). 

If V\{G) is a strong obstruction, is nonzero but is zero. Thus, 
assumming PHI, there are three possibilities: 

1. is empty, and is nonempty and contains an integer point. 

2. Both Q'^X and P^ are nonempty, the affine span of does not contain 
an integer point and P^ contains an integer point. 

3. Both and P^ are nonempty. The affine span of Q'^ contains an 
integer point, but does not. And P^ contains an integer point. 

In the first two cases, A is a robust obstruction. As per SH (Hypothe- 
sis [7]6]7|), for almost all A, the Ehrhart quasipolynomial of Q'^ is saturated: 
this means (cf. the proof of Theorem l3.1.ip . if the affine span of Q'^ contains 
an integer point then also contains an integer point. And hence, with 
a high probability, the third case should not occur. In other words, strong 
obstructions can be expected to be robust with a high probability. 
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Let us call a strong obstruction A fragile if it is not robust; this means 
the affine span of Qf contains an integer point, but does not. By SH 
(Hypothesis I7.6.7|) . if A is fragile, then for some k = poly(m), contains 
an intger point, and hence, k\ is not obstruction. Thus fragile obstructions 
are close to not being obstructions, and furthermore, are expected to be 
rare, as argued above. This is why we are focussing on robust obstructions. 

It may be remarked that the only SH needed in the argument above 
is the one (Hypothesis I7.6.7P for the structural constant my This is a 
special case of the SH for the subgroup restriction problem (cf. Section 13. 4p 
specialized to the embedding Gg ^ G. In particular, we do not need SH 
for the structural constant s^; i.e., for the more difficult decision problem in 
geometric invariant theory (cf. Problem 11.1.41 and Section [3.5^ . 



7.6.7 On discovery of robust obstructions 

It may be conjectured that not just the verification (cf. Theorem I7.6.5P 
but also the discovery of robust obstructions is easy for the problem under 
consideration. In this section we shall give an argument in support of this 
conjecture for geometric (robust) obstructions (which may be conjectured to 
exist in the problem under consideration). For this we need to reformulate 
the notions of strong and robust obstructions (Definition I7.6.3j) as follows. 

Let Tz be the set of pairs {d, A) such that is nonzero and Sz the set 
of pairs {d, A) such that is nonzero. 



Proposition 7.6.8 Assuming PHI above (Hypotheses 7.6.1 and 7.6.2), Tz 



and Sz are finitely generated semigroups with respect to addition. 

These semi-groups are analogues of the Littlewood-Richardson semigroup 
(Section I2.2.2p in this setting. 

Proof: The proof is similar to that for the Littlewood-Richardson semigroup 

m- 

For given d and A, the polytope P^ in PHI for (Hvpothesis 17.6.2]) has 
a specification of the form 

Ax<b (7.4) 

where A depends only the variety Z = A\Yi[f'], but not on d or A, and 
b depends homogeneously and linearly on d and A. Let P be the polytope 
defined by the inequalities (j7.4p where both d and A are treated as variables. 
Then P is a polyhedral cone (through the origin) in the ambient space 
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containing P with the coordinates x, d and A. Let Pi be the set of integer 
points in P. It is a finitely generated semigroup since P is a polyhedral cone. 
Let T]R be the orthogonal projection of P on the hyperplane corresponding 
to the coordinates d and A. Now Ti is simply the projection of Pi. Hence 
it is a finitely generated semigroup as well. 

The proof for Si is similar, with S'm defined similarly. Q.E.D. 

The polyhedral cones Tk and here are analogues of the Littlewood- 
Richardson cone (Section I2.2.2p in this setting. Note that (d, A) e iff P^ 
is nonempty; similarly for Sr. 

A Weyl module V\{G) is a strong obstruction for the pair (/, g) of degree 
d iff [d, A) occurs in Ti but not in Si. It is a robust obstruction iff it occurs 
in Tfj but not in Si. It is a geometric obstruction iff it occurs in Tr but not 
in Sr. It is a modular obstruction iff it occurs in Tr and also in S^ but not 
in Si. 

Assuming PHI (Hypothesis 17.6.2]) . whether (d, A) belongs to Tr can be 
determined in polynomial time by linear programming, since {d, A) G Tr 
iff P^ is nonempty. Similarly, assuming PHI (Hypothesis I7.6.ip . whether 
(d, A) € 5k can be determined in polynomial time. 

The following is a stronger complement to PHI. 

Hypothesis 7.6.9 (PHI*) 

Whether T^\S^ is nonempty can be determined in polynomial time; i.e., 
poly{n, (m)) time. If so, the algorithm can also output {d,X) S \ S'k of 
polynomial bit length. 

Proposition 7.6.10 Assuming PHI*, given n andm, the problem of decid- 
ing if a geometric obstruction exists for the pair (/, g) , and finding one if one 
exists, belongs to the complexity class P; i.e., it can be done in poly{n, {m)) 
time. 

This immediately follows from Hypothesis 17.6.91 since {d, A) is a geometric 
obstruction iff (d. A) € \ S'r. 

Hypothesis 17.6.91 is supported by the following: 

Proposition 7.6.11 Assuming PHI (Hypotheses \ 7. 6. i\ and \7. 67^ , Hypoth- 
esis 1 7. 6. 5\ holds if and S^ have polynomially many explicitly given con- 
straints with the specification of polynomial bit length; here polynomial means 
poly{n, (m)). 
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The proposition holds even if the polytope has exponentially many 
constraints, as long as it is given by a separation oracle that works in poly- 
nomial time. 

Proof: It suffices to check if satisfies each constraint of T^. This can be 
done in polynomial time using the linear programming algorithm in |GLSj . 
Specifically, let l(y) > be a constraint of Tr. Then we just need to minimize 
l{y) on S'k and check if the minimum exceeds zero. Q.E.D. 

But this method does not work when the number of constraints of Tk is 
exponential, as expected in the context of the lower bound problems under 
consideration. In fact, no generic black-box-type algorithm, like the one in 
[GLSj based on just a membership or separation oracle for Tr, can be used 
to prove (4) when the number of constraints of is exponential. 

Fortunately, this is not a serious problem. A basic principle in combi- 
natorial optimization, as illustrated in |GLSj . is that a complexity theoretic 
property that holds for polytopes with polynomially many constraints will 
also hold for polytopes with exponentially many constraints, provided these 
constraints are sufficiently well-behaved. For example, Edmond's perfect 
matching polytope for nonbipartite graphs has complexity-theoretic proper- 
ties similar to the perfect matching polytope for bipartite graphs, though it 
can have exponentially many constraints. We have already remarked that 
Tk and 5k are analogues of the Littlewood-Richardson cones. The facets of 
the Littlewood-Richardson cone have a very nice explicit description |Kll IZ] . 
The cones T^jS'ir here are expected to have similar nice explicit descrip- 
tion. This is why Hypothesis 17.6.91 can be expected to hold even if the 
number of constraints of is exponential, just as it holds even when 
has exponentially many constraints. But a polynomial-time algorithm as in 
Hypothesis 17.6.91 would have to depend crucially on the specific nature of 
the facets (constraints) of Tk in the spirit of the linear-programming-based 
algorithm for the construction of a maximum-weight perfect matching in 
nonbipartite graphs [Edj . where too the number of constraints is exponen- 
tial but the algorithm still works because of the structure theorems based 
on the specific nature of the constraints. 

7.7 Arithmetic form of the P vs NP problem in 
characteristic zero 

We turn now to the arithemetic form of the P vs. NP problem in character- 
istic zero. The arguments are essentially verbatim translations of those for 
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the arithmetic form of the vs. NC problem in the preceding section. 
Hence we shall be brief. 

In the preceding section h{X) was perm(X) and giX) was det(y). Now 
h{X) and g{Y) would be explicit (co)-NP-complete and P-complete func- 
tions E{X) and H{Y) constructed in |GCT1| . They can be thought of as 
points in suitable W = Sym^-X^) and V = Sym^[y], k = 0{n^),l = 0{'m^), 
with the natural action of GL[X) and G = GL{Y), where n denotes the 
number of input parameters and m denotes the circuit size parameter in 
the lower bound problem. These functions are extremely special like the 
determinant and the permanent in the sense that they are "almost" char- 
acterized by their stabilizers as explained in [GCTlj -and this is enough for 
our purposes. 

We again have a natural embedding (j) : P{W) — > P{V), which lets us 
define / = (j){h). The class variety for NP is defined to be Ay[/] C P{V), 
the projective closure of the orbit Gf. The class variety for P is Ay[(j(] C 
P{V), which is defined to be the projective closure of G[g], where [g] denotes 
the set of points in P{V) that are stabilized by Gg C G, the stabilizer of g. 
An explicit description of Gg is given in [GCTlj : cf. Section 7 therein. To 
show P 7^ NP in characteristic zero, it suffices to show that Av[/] is not a 
subvariety of Ay [5] for all large enough n, if m = poly(n) (cf. Conjecture 
7.4. in [GCTlj ). For this, in turn, it suffices to show existence of strong 
obstructions, defined very much as in Section 17.61 for all n, assumming 
m = poly(n). 

We can then formulate PHI for the new h{X) and g{Y) just as in Hy- 
potheses 17.6.11 and 17.6.21 and the notion of a robust obstruction as in Defi- 
nition [TiHiSl We then have: 

Theorem 7.7.1 (Verification of obstructions) 

Analogues of Theorems \ 7.6.5\ and \ 7.6.6\ holds for h{X) = E{X) and 
g{Y)=H{Y). 

Furthermore, even discovery of robust obstructions can be conjectured 
to be easy (poly-time)-this would follow from the obvious analogue of Hy- 
pothesis 17.6.91 here. 

Heuristic argument for existence of robust obstructions is very similar 
to the one in Section 17.6.61 It needs SH for the special case of the subgroup 
restriction problem for the embedding Gg ^ G. The group Gg, as described 
in [GCTlj . is a product of some copies of the algebraic torus and the sym- 
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metric group. The subgroup restriction problem in this case is akin to but 
harder than the plethysm problem. 
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